with Scrapfly and Zenscrape?
Automate content extraction from any text-based source using AI, LLM, and custom parsing. See the documentation
Retrieve the number of remaining credits in Zenscrape. See the documentation
Retrieve current subscription and account usage details from Scrapfly. See the documentation
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
scrapfly: {
type: "app",
app: "scrapfly",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.scrapfly.io/scrape`,
params: {
key: `${this.scrapfly.$auth.api_key}`,
url: `https://pipedream.com`,
render_js: `true`,
asp: `true`,
},
})
},
})
The Zenscrape API offers a versatile way to extract structured data from any webpage without the hassle of managing proxies or parsing HTML. By leveraging Zenscrape on Pipedream, you can automate data extraction, receive real-time results, and integrate scraped data with hundreds of other services. Create workflows that trigger on schedules or events, process the data, and perform actions like updating databases, sending alerts, or generating reports.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
zenscrape: {
type: "app",
app: "zenscrape",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://app.zenscrape.com/api/v1/get`,
headers: {
"apikey": `${this.zenscrape.$auth.api_key}`,
},
params: {
url: `https://httpbin.org/anything`,
},
})
},
})