with Octoparse and n8n.io?
The Octoparse API allows you to automate the extraction of web data without coding, making it a powerful tool for data-driven workflows. With this API, you can control your scraping tasks, retrieve extracted data, and manage your account programmatically. When combined with Pipedream's serverless execution environment, you can build custom workflows to process, store, or act upon the data fetched by Octoparse. This integration can be a cornerstone for solutions in market research, competitor analysis, price monitoring, or lead generation.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
octoparse: {
type: "app",
app: "octoparse",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://openapi.octoparse.com/taskGroup`,
headers: {
Authorization: `Bearer ${this.octoparse.$auth.oauth_access_token}`,
},
})
},
})
The n8n.io API provides a platform for automating workflows in a node-based structure that allows for integrations across various services and apps. Leveraging this API within Pipedream enables you to orchestrate complex operations, connect disparate systems, and trigger actions conditionally, transforming and passing data between services without writing extensive code.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
n8n_io: {
type: "app",
app: "n8n_io",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://${this.n8n_io.$auth.domain}.app.n8n.cloud/api/v1/workflows`,
headers: {
"Accept": `application/json`,
"X-N8N-API-KEY": `${this.n8n_io.$auth.api_key}`,
},
})
},
})