Airbyte

The biggest community of ELT Data Connectors. Move data from any DB/API to any Database/Warehouse!

Integrate the Airbyte API with the AWS API

Setup the Airbyte API trigger to run a workflow which integrates with the AWS API. Pipedream's integration platform allows you to integrate Airbyte and AWS remarkably fast. Free for developers.

Create Workspace with Airbyte API on New Scheduled Tasks from AWS API
AWS + Airbyte
 
Try it
Create Workspace with Airbyte API on New SNS Messages from AWS API
AWS + Airbyte
 
Try it
Delete Workspace with Airbyte API on New Scheduled Tasks from AWS API
AWS + Airbyte
 
Try it
Delete Workspace with Airbyte API on New SNS Messages from AWS API
AWS + Airbyte
 
Try it
List Workspaces with Airbyte API on New Scheduled Tasks from AWS API
AWS + Airbyte
 
Try it
New Scheduled Tasks from the AWS API

Creates a Step Function State Machine to publish a message to an SNS topic at a specific timestamp. The SNS topic delivers the message to this Pipedream source, and the source emits it as a new event.

 
Try it
New SNS Messages from the AWS API

Creates an SNS topic in your AWS account. Messages published to this topic are emitted from the Pipedream source.

 
Try it
New Inbound SES Emails from the AWS API

The source subscribes to all emails delivered to a specific domain configured in AWS SES. When an email is sent to any address at the domain, this event source emits that email as a formatted event. These events can trigger a Pipedream workflow and can be consumed via SSE or REST API.

 
Try it
New Deleted S3 File from the AWS API

Emit new event when a file is deleted from a S3 bucket

 
Try it
New DynamoDB Stream Event from the AWS API

Emit new event when a DynamoDB stream receives new events. See the docs here

 
Try it
Create Workspace with the Airbyte API

Creates a workspace on Airbyte. See the documentation

 
Try it
Delete Workspace with the Airbyte API

Deletes a workspace on Airbyte. See the documentation

 
Try it
List Workspaces with the Airbyte API

Lists workspaces on Airbyte. See the documentation

 
Try it
Update Workspace with the Airbyte API

Updates a workspace on Airbyte. See the documentation

 
Try it
CloudWatch Logs - Put Log Event with the AWS API

Uploads a log event to the specified log stream. See docs

 
Try it

Overview of Airbyte

The Airbyte API allows for creating and managing data integration pipelines between various sources and destinations, automating data synchronization tasks, and monitoring the status of those pipelines. On Pipedream, you can leverage the Airbyte API to build intricate workflows that react to data events, manipulate and store data, and connect to other services to create rich, automated data pipelines.

Connect Airbyte

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    https_airbyte_com: {
      type: "app",
      app: "https_airbyte_com",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `${this.https_airbyte_com.$auth.url}/v1/connections`,
      headers: {
        Authorization: `Bearer ${this.https_airbyte_com.$auth.api_key}`,
      },
    })
  },
})

Overview of AWS

The AWS API unlocks endless possibilities for automation with Pipedream. With this powerful combo, you can manage your AWS services and resources, automate deployment workflows, process data, and react to events across your AWS infrastructure. Pipedream offers a serverless platform for creating workflows triggered by various events that can execute AWS SDK functions, making it an efficient tool to integrate, automate, and orchestrate tasks across AWS services and other apps.

Connect AWS

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
import AWS from 'aws-sdk'

export default defineComponent({
  props: {
    aws: {
      type: "app",
      app: "aws",
    }
  },
  async run({steps, $}) {
    const { accessKeyId, secretAccessKey } = this.aws.$auth
    
    /* Now, pass the accessKeyId and secretAccessKey to the constructor for your desired service. For example:
    
    const dynamodb = new AWS.DynamoDB({
      accessKeyId, 
      secretAccessKey,
      region: 'us-east-1',
    })
    
    */
  },
})