The easiest way to extract structured data from any website with no coding.
Creates a Step Function State Machine to publish a message to an SNS topic at a specific timestamp. The SNS topic delivers the message to this Pipedream source, and the source emits it as a new event.
Emits an event when a Browse AI task is completed. See the documentation
Creates an SNS topic in your AWS account. Messages published to this topic are emitted from the Pipedream source.
Emit new event when a task finishes with an error. See the documentation
The source subscribes to all emails delivered to a specific domain configured in AWS SES. When an email is sent to any address at the domain, this event source emits that email as a formatted event. These events can trigger a Pipedream workflow and can be consumed via SSE or REST API.
Runs a robot on-demand with custom input parameters. See the documentation
The Browse AI API enables the automation of data extraction from websites, turning web pages into organized data. It's built for non-coders and coders alike, allowing for custom web scraping and monitoring tasks. Within Pipedream, you can harness Browse AI to create intricate workflows that trigger actions in other apps based on the data you extract. Think of automated competitive analysis, price tracking, or content changes detection, all streamlined through Pipedream's serverless platform.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
browse_ai: {
type: "app",
app: "browse_ai",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.browse.ai/v2/robots`,
headers: {
Authorization: `Bearer ${this.browse_ai.$auth.api_key}`,
},
})
},
})
The AWS API unlocks endless possibilities for automation with Pipedream. With this powerful combo, you can manage your AWS services and resources, automate deployment workflows, process data, and react to events across your AWS infrastructure. Pipedream offers a serverless platform for creating workflows triggered by various events that can execute AWS SDK functions, making it an efficient tool to integrate, automate, and orchestrate tasks across AWS services and other apps.
import AWS from 'aws-sdk'
export default defineComponent({
props: {
aws: {
type: "app",
app: "aws",
}
},
async run({steps, $}) {
const { accessKeyId, secretAccessKey } = this.aws.$auth
/* Now, pass the accessKeyId and secretAccessKey to the constructor for your desired service. For example:
const dynamodb = new AWS.DynamoDB({
accessKeyId,
secretAccessKey,
region: 'us-east-1',
})
*/
},
})