with Oxylabs and Perigon?
Emit new event when a new scheduled run is completed. See the documentation
Establish a proxy session using the Residential Proxy endpoint. See the documentation
The Oxylabs API provides robust tools for web data extraction, enabling you to gather vast amounts of data efficiently from various sources across the web. With Pipedream's serverless platform, you can harness this power to create automated workflows that trigger on specific events, process the data, and connect to other services. Whether you're monitoring brand sentiment, tracking prices, or conducting market research, integrating Oxylabs with Pipedream can significantly streamline your data collection and analysis tasks.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
oxylabs: {
type: "app",
app: "oxylabs",
}
},
async run({steps, $}) {
const data = {
"geo_location": `United States`,
"url": `https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html`,
"source": `universal`,
}
return await axios($, {
method: "post",
url: `https://${this.oxylabs.$auth.api_name}.oxylabs.io/v1/queries`,
headers: {
"Content-Type": `application/json`,
},
auth: {
username: `${this.oxylabs.$auth.username}`,
password: `${this.oxylabs.$auth.password}`,
},
data,
})
},
})
The Perigon API enables the creation and management of complex data relationships, allowing for the automation of data-driven processes. With this API, you can streamline data synchronization, manage master data, and enhance business intelligence by connecting Perigon's data capabilities with various apps and services. Automating workflows with the Perigon API on Pipedream can lead to increased efficiency by reducing manual data handling, ensuring data accuracy, and providing actionable insights through connected systems.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
perigon: {
type: "app",
app: "perigon",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.goperigon.com/v1/all`,
params: {
apiKey: `${this.perigon.$auth.apiKey}`,
},
})
},
})