with WebScraper.IO and Dex?
Emit new event when a page scraping job has completed. See the docs here
Creates a scraping job (scrapes a sitemap). See the docs here
Creates a sitemap for the selected website. See the docs here
Adds a new contact or updates an existing one if the email address already exists in the Dex system. See the documentation
Retrieves a list of scraping jobs for a sitemap. See the docs here
The WebScraper.IO API allows you to programmatically perform web scraping tasks, extracting structured data from websites. With the API, you can automate the gathering of web content for analysis, monitoring, and integration with other data sources. In Pipedream, you can leverage this API to build workflows that process, analyze, and act on the data you scrape without writing code for backend infrastructure.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
webscraper_io: {
type: "app",
app: "webscraper_io",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.webscraper.io/api/v1/sitemaps`,
params: {
api_token: `${this.webscraper_io.$auth.api_key}`,
},
})
},
})
The Dex API offers a path to streamline and automate your relationship management by allowing you to sync, update, and interact with your personal Dex CRM data programmatically. On Pipedream, you can leverage this API to create powerful automations that keep your network vibrant and your connections strong, without manual effort. By integrating Dex with other apps on Pipedream, you can tailor workflows that sync contact info, set reminders for follow-ups, or trigger personalized communications based on various criteria.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
dex: {
type: "app",
app: "dex",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.getdex.com/api/rest/contacts`,
headers: {
"x-hasura-dex-api-key": `${this.dex.$auth.api_key}`,
},
})
},
})