The Airbyte API allows for creating and managing data integration pipelines between various sources and destinations, automating data synchronization tasks, and monitoring the status of those pipelines. On Pipedream, you can leverage the Airbyte API to build intricate workflows that react to data events, manipulate and store data, and connect to other services to create rich, automated data pipelines.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
https_airbyte_com: {
type: "app",
app: "https_airbyte_com",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.airbyte.com/v1/connections`,
headers: {
Authorization: `Bearer ${this.https_airbyte_com.$auth.oauth_access_token}`,
},
})
},
})
Sync New Database Entries to CRM: Trigger a workflow whenever new entries are added to a Postgres database; use the Airbyte API to sync this new data to a CRM platform like Salesforce, keeping sales data updated in real-time.
Automated Reporting Pipeline: Combine data from multiple sources, like Google Analytics and advertising platforms, via Airbyte at regular intervals. Then, process and send the aggregated data to Google Sheets for easy access and automated reporting.
Real-time Data Backup: Set up a workflow that uses Airbyte to replicate data from primary databases to secondary storage solutions, such as Amazon S3, ensuring real-time or scheduled backups for disaster recovery purposes.
Airbyte uses OAuth authentication. When you connect your Airbyte account, Pipedream will open a popup window where you can sign into Airbyte and grant Pipedream permission to connect to your account. Pipedream securely stores and automatically refreshes the OAuth tokens so you can easily authenticate any Airbyte API.
Pipedream requests the following authorization scopes when you connect your account:
POSThttps://api.airbyte.com/v1/applications/tokencontent-type: application/x-www-form-urlencodedaccept: application/jsonclient_id={{custom_fields.client_id}}&client_secret={{custom_fields.client_secret}}&grant_type=client_credentialsPOSThttps://api.airbyte.com/v1/applications/tokencontent-type: application/x-www-form-urlencodedaccept: application/jsonclient_id={{custom_fields.client_id}}&client_secret={{custom_fields.client_secret}}&grant_type=client_credentials