Making web data extraction easy and accessible for everyone.
Creates a scraping job (scrapes a sitemap). See the docs here
Adds a contact to a specific static list. See the documentation
Creates a sitemap for the selected website. See the docs here
Create or update a batch of contacts by its ID or email. See the documentation
Retrieves a list of scraping jobs for a sitemap. See the docs here
The WebScraper.IO API allows you to programmatically perform web scraping tasks, extracting structured data from websites. With the API, you can automate the gathering of web content for analysis, monitoring, and integration with other data sources. In Pipedream, you can leverage this API to build workflows that process, analyze, and act on the data you scrape without writing code for backend infrastructure.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
webscraper_io: {
type: "app",
app: "webscraper_io",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.webscraper.io/api/v1/sitemaps`,
params: {
api_token: `${this.webscraper_io.$auth.api_key}`,
},
})
},
})
The HubSpot API enables developers to integrate into HubSpots CRM, CMS, Conversations, and other features. It allows for automated management of contacts, companies, deals, and marketing campaigns, enabling custom workflows, data synchronization, and task automation. This streamlines operations and boosts customer engagement, with real-time updates for rapid response to market changes.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
hubspot: {
type: "app",
app: "hubspot",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.hubapi.com/integrations/v1/me`,
headers: {
Authorization: `Bearer ${this.hubspot.$auth.oauth_access_token}`,
},
})
},
})