The Zyte API provides programmatic access to web data extraction services, allowing you to pull structured data from websites efficiently. Within Pipedream, you can leverage the Zyte API to create powerful serverless workflows that automate data collection, monitor web content changes, or enrich your datasets with web-sourced information. By connecting Zyte to other apps on Pipedream, you can easily integrate web scraping into your data processing pipelines, event-driven applications, and more, with minimal setup and no server maintenance.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
zyte_api: {
type: "app",
app: "zyte_api",
}
},
async run({steps, $}) {
const data = {
"url": "https://books.toscrape.com/",
"httpResponseBody": true
}
return await axios($, {
method: "post",
url: `https://api.zyte.com/v1/extract`,
headers: {
"Content-Type": `application/json`,
},
auth: {
username: `${this.zyte_api.$auth.api_key}`,
password: ``,
},
data,
})
},
})
Automated Market Research: Trigger a workflow on a schedule to use Zyte API for scraping product information from e-commerce sites. Process this data and send it to a Google Sheets spreadsheet for analysis, helping businesses track competitor pricing and inventory changes in real-time.
Content Change Detection: Set up a Pipedream workflow that uses the Zyte API to periodically check a set of web pages for content updates or changes. If changes are detected, automatically notify your team via Slack or email, ensuring that you are always informed about critical updates to competitors' websites or industry news portals.
Lead Generation Pipeline: Create a workflow on Pipedream that utilizes Zyte API to extract contact information from business directories or professional social networks. Enrich this data with additional details and automatically add it to a CRM system like Salesforce, streamlining your lead generation and outreach efforts.
Zyte API uses API keys for authentication. When you connect your Zyte API account, Pipedream securely stores the keys so you can easily authenticate to Zyte API APIs in both code and no-code steps.