Unlock the power of data at scale without the hassle of getting blocked with zenscrape's web scraping API.
Write Python and use any of the 350k+ PyPi packages available. Refer to the Pipedream Python docs to learn more.
The Zenscrape API offers a versatile way to extract structured data from any webpage without the hassle of managing proxies or parsing HTML. By leveraging Zenscrape on Pipedream, you can automate data extraction, receive real-time results, and integrate scraped data with hundreds of other services. Create workflows that trigger on schedules or events, process the data, and perform actions like updating databases, sending alerts, or generating reports.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
zenscrape: {
type: "app",
app: "zenscrape",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://app.zenscrape.com/api/v1/get`,
headers: {
"apikey": `${this.zenscrape.$auth.api_key}`,
},
params: {
url: `https://httpbin.org/anything`,
},
})
},
})
Develop, run and deploy your Python code in Pipedream workflows. Integrate seamlessly between no-code steps, with connected accounts, or integrate Data Stores and manipulate files within a workflow.
This includes installing PyPI packages, within your code without having to manage a requirements.txt
file or running pip
.
Below is an example of using Python to access data from the trigger of the workflow, and sharing it with subsequent workflow steps:
def handler(pd: "pipedream"):
# Reference data from previous steps
print(pd.steps["trigger"]["context"]["id"])
# Return data for use in future steps
return {"foo": {"test":True}}