with Octoparse and Phantombuster?
Emit new events when new outputs are created. See the docs here
The Octoparse API allows you to automate the extraction of web data without coding, making it a powerful tool for data-driven workflows. With this API, you can control your scraping tasks, retrieve extracted data, and manage your account programmatically. When combined with Pipedream's serverless execution environment, you can build custom workflows to process, store, or act upon the data fetched by Octoparse. This integration can be a cornerstone for solutions in market research, competitor analysis, price monitoring, or lead generation.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
octoparse: {
type: "app",
app: "octoparse",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://openapi.octoparse.com/taskGroup`,
headers: {
Authorization: `Bearer ${this.octoparse.$auth.oauth_access_token}`,
},
})
},
})
Phantombuster is a tool that lets you automate interactions with web platforms to extract data, manage social media campaigns, and automate web actions. Using its API on Pipedream, you can seamlessly integrate these automation capabilities into complex workflows. Imagine orchestrating a symphony where Phantombuster plays the strings—pulling data from LinkedIn, sending tailored tweets, or automating lead generation—while Pipedream conducts, integrating these actions with other apps and services for a harmonious data-driven performance.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
phantombuster: {
type: "app",
app: "phantombuster",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.phantombuster.com/api/v1/user`,
headers: {
"X-Phantombuster-Key-1": `${this.phantombuster.$auth.api_key}`,
},
})
},
})