with Oxylabs and Autom?
Emit new event when a new scheduled run is completed. See the documentation
Establish a proxy session using the Residential Proxy endpoint. See the documentation
Scrape the results from Bing search engine via the Autom.dev service. See the documentation
Scrape the results from Brave search engine using Autom.dev. See the documentation
Scrape the results from the Google search engine using the Autom.dev API. See the documentation
The Oxylabs API provides robust tools for web data extraction, enabling you to gather vast amounts of data efficiently from various sources across the web. With Pipedream's serverless platform, you can harness this power to create automated workflows that trigger on specific events, process the data, and connect to other services. Whether you're monitoring brand sentiment, tracking prices, or conducting market research, integrating Oxylabs with Pipedream can significantly streamline your data collection and analysis tasks.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
oxylabs: {
type: "app",
app: "oxylabs",
}
},
async run({steps, $}) {
const data = {
"geo_location": `United States`,
"url": `https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html`,
"source": `universal`,
}
return await axios($, {
method: "post",
url: `https://${this.oxylabs.$auth.api_name}.oxylabs.io/v1/queries`,
headers: {
"Content-Type": `application/json`,
},
auth: {
username: `${this.oxylabs.$auth.username}`,
password: `${this.oxylabs.$auth.password}`,
},
data,
})
},
})
Autom API offers a rich set of features for creating, managing, and deploying automations. With its capabilities, you can streamline tasks by setting up triggers and actions based on certain conditions. When used within Pipedream, you can harness these features to create robust, serverless workflows that integrate with numerous other services and APIs. Autom API's interaction with Pipedream allows for building scalable automation solutions that respond to real-time events and connect with a multitude of apps to perform complex tasks seamlessly.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
autom: {
type: "app",
app: "autom",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://autom.dev/api/usage`,
headers: {
"Content-Type": `application/json`,
"x-api-key": `${this.autom.$auth.api_key}`,
},
})
},
})