Apify

Apify is the place to find, develop, buy and run cloud programs called actors. Use actors to turn any website into an API.

Integrate the Apify API with the AWS API

Setup the Apify API trigger to run a workflow which integrates with the AWS API. Pipedream's integration platform allows you to integrate Apify and AWS remarkably fast. Free for developers.

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Run Actor with Apify API on New Scheduled Tasks from AWS API
AWS + Apify
 
Try it
Run Actor with Apify API on New SNS Messages from AWS API
AWS + Apify
 
Try it
Scrape Single URL with Apify API on New Scheduled Tasks from AWS API
AWS + Apify
 
Try it
Scrape Single URL with Apify API on New SNS Messages from AWS API
AWS + Apify
 
Try it
Set Key-Value Store Record with Apify API on New Scheduled Tasks from AWS API
AWS + Apify
 
Try it
New Finished Actor Run (Instant) from the Apify API

Emit new event when a selected actor is run and finishes.

 
Try it
New Scheduled Tasks from the AWS API

Creates a Step Function State Machine to publish a message to an SNS topic at a specific timestamp. The SNS topic delivers the message to this Pipedream source, and the source emits it as a new event.

 
Try it
New Finished Task Run (Instant) from the Apify API

Emit new event when a selected task is run and finishes.

 
Try it
New SNS Messages from the AWS API

Creates an SNS topic in your AWS account. Messages published to this topic are emitted from the Pipedream source.

 
Try it
New Inbound SES Emails from the AWS API

The source subscribes to all emails delivered to a specific domain configured in AWS SES. When an email is sent to any address at the domain, this event source emits that email as a formatted event. These events can trigger a Pipedream workflow and can be consumed via SSE or REST API.

 
Try it
Run Actor with the Apify API

Performs an execution of a selected actor in Apify. See the documentation

 
Try it
Scrape Single URL with the Apify API

Executes a scraper on a specific website and returns its content as text. This action is perfect for extracting content from a single page.

 
Try it
CloudWatch Logs - Put Log Event with the AWS API

Uploads a log event to the specified log stream. See docs

 
Try it
Set Key-Value Store Record with the Apify API

Create or update a record in the key-value store of Apify. See the documentation

 
Try it
DynamoDB - Create Table with the AWS API

Creates a new table to your account. See docs

 
Try it

Overview of Apify

The Apify API unleashes the power to automate web scraping, process data, and orchestrate web automation workflows. By utilizing Apify on Pipedream, you can create dynamic serverless workflows to manage tasks like extracting data from websites, running browser automation, and scheduling these jobs to run autonomously. It integrates smoothly with Pipedream's capabilities to trigger actions on various other apps, store the results, and manage complex data flow with minimal setup.

Connect Apify

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    apify: {
      type: "app",
      app: "apify",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://api.apify.com/v2/users/me`,
      headers: {
        Authorization: `Bearer ${this.apify.$auth.api_token}`,
      },
    })
  },
})

Overview of AWS

The AWS API unlocks endless possibilities for automation with Pipedream. With this powerful combo, you can manage your AWS services and resources, automate deployment workflows, process data, and react to events across your AWS infrastructure. Pipedream offers a serverless platform for creating workflows triggered by various events that can execute AWS SDK functions, making it an efficient tool to integrate, automate, and orchestrate tasks across AWS services and other apps.

Connect AWS

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
import AWS from 'aws-sdk'

export default defineComponent({
  props: {
    aws: {
      type: "app",
      app: "aws",
    }
  },
  async run({steps, $}) {
    const { accessKeyId, secretAccessKey } = this.aws.$auth
    
    /* Now, pass the accessKeyId and secretAccessKey to the constructor for your desired service. For example:
    
    const dynamodb = new AWS.DynamoDB({
      accessKeyId, 
      secretAccessKey,
      region: 'us-east-1',
    })
    
    */
  },
})

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo