Making web data extraction easy and accessible for everyone.
Emit new event when a page scraping job has completed. See the docs here
Emit new event each time a comment is added to a spreadsheet.
Emit new event each time a row or rows are added to the bottom of a spreadsheet.
Emit new event each time a row or cell is updated in a spreadsheet.
Emit new event each time a new worksheet is created in a spreadsheet.
Creates a scraping job (scrapes a sitemap). See the docs here
Add a single row of data to Google Sheets. See the documentation
Creates a sitemap for the selected website. See the docs here
Add multiple rows of data to a Google Sheet. See the documentation
Retrieves a list of scraping jobs for a sitemap. See the docs here
The WebScraper.IO API allows you to programmatically perform web scraping tasks, extracting structured data from websites. With the API, you can automate the gathering of web content for analysis, monitoring, and integration with other data sources. In Pipedream, you can leverage this API to build workflows that process, analyze, and act on the data you scrape without writing code for backend infrastructure.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
webscraper_io: {
type: "app",
app: "webscraper_io",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.webscraper.io/api/v1/sitemaps`,
params: {
api_token: `${this.webscraper_io.$auth.api_key}`,
},
})
},
})
The Google Sheets API allows for the creation, reading, updating, and deletion of data within Google Sheets, enabling a robust platform for spreadsheet management and data manipulation. Through Pipedream, you can craft serverless workflows that respond to various triggers, such as webhook events, emails, or scheduled times, to interact with Google Sheets. This synergy can automate reporting, synchronize data across applications, manage inventory, track leads in a CRM, or even conduct survey analysis by updating and retrieving sheet data on the fly.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
google_sheets: {
type: "app",
app: "google_sheets",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://www.googleapis.com/oauth2/v1/userinfo`,
headers: {
Authorization: `Bearer ${this.google_sheets.$auth.oauth_access_token}`,
},
})
},
})