Making web data extraction easy and accessible for everyone.
Emit new event when a fresh response is received on the event registration form. User needs to configure the prop of the specific event. See the documentation
Emit new event when a page scraping job has completed. See the docs here
Emit new event when a new lead is captured through a form. See the documentation
Creates a scraping job (scrapes a sitemap). See the docs here
Queries the Analytics Finder to get analytics for the specified entity i.e company, account, campaign. See the docs here
Creates a sitemap for the selected website. See the docs here
Sample query using analytics finder that gets analytics for a particular account for date range starting in a given year. See the docs here
Retrieves a list of scraping jobs for a sitemap. See the docs here
The WebScraper.IO API allows you to programmatically perform web scraping tasks, extracting structured data from websites. With the API, you can automate the gathering of web content for analysis, monitoring, and integration with other data sources. In Pipedream, you can leverage this API to build workflows that process, analyze, and act on the data you scrape without writing code for backend infrastructure.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
webscraper_io: {
type: "app",
app: "webscraper_io",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.webscraper.io/api/v1/sitemaps`,
params: {
api_token: `${this.webscraper_io.$auth.api_key}`,
},
})
},
})
The LinkedIn Ads API on Pipedream enables you to automate and integrate your LinkedIn advertising efforts with other services. Fetch campaign data, manage ad accounts, or automate ad creation and adjustments. With Pipedream, you can trigger workflows with HTTP requests, emails, and on a schedule, and connect to thousands of other apps with minimal effort.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
linkedin_ads: {
type: "app",
app: "linkedin_ads",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.linkedin.com/v2/me`,
headers: {
Authorization: `Bearer ${this.linkedin_ads.$auth.oauth_access_token}`,
},
})
},
})