with iScraper and ZenRows?
Scrape HTML of the URL with CSS Selectors. See the documentation
The iScraper API is a powerful tool for extracting information from Instagram, making it possible to gather rich data sets from user profiles, hashtags, and posts. When leveraged through Pipedream, iScraper can become a part of diverse workflows, automating the collection of social media insights and integrating them with other services for analysis, reporting, or social media management. With Pipedream, you can create event-driven workflows that react to new data from iScraper, orchestrate data flow across multiple services, and handle complex tasks without managing infrastructure.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
iscraper: {
type: "app",
app: "iscraper",
}
},
async run({steps, $}) {
const data = {
"profile_id": `williamhgates`,
}
return await axios($, {
method: "post",
url: `https://api.iscraper.io/v2/profile-details`,
headers: {
"Content-Type": `application/json`,
"X-API-KEY": `${this.iscraper.$auth.api_key}`,
},
data,
})
},
})
ZenRows API specializes in web scraping and handles issues like CAPTCHAs, JavaScript rendering, and rotating proxies to ensure successful data extraction. In Pipedream, you can pair the ZenRows API with numerous other services to create automated workflows that respond to events, process and analyze scraped data, or even trigger actions based on the data collected. Whether you need to monitor changes on web pages, aggregate content for analysis, or feed scraped data into other applications, ZenRows' integration on Pipedream simplifies these tasks.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
zenrows: {
type: "app",
app: "zenrows",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.zenrows.com/v1/`,
params: {
apikey: `${this.zenrows.$auth.api_key}`,
url: `https://httpbin.io/anything`,
},
})
},
})