with Oxylabs and News API?
Emit new event when a new scheduled run is completed. See the documentation
Establish a proxy session using the Residential Proxy endpoint. See the documentation
Search through millions of articles from over 150,000 large and small news sources and blogs. See the documentation
Retrieve live top and breaking headlines for a category, single source, multiple sources, or keywords. See the documentation
The Oxylabs API provides robust tools for web data extraction, enabling you to gather vast amounts of data efficiently from various sources across the web. With Pipedream's serverless platform, you can harness this power to create automated workflows that trigger on specific events, process the data, and connect to other services. Whether you're monitoring brand sentiment, tracking prices, or conducting market research, integrating Oxylabs with Pipedream can significantly streamline your data collection and analysis tasks.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
oxylabs: {
type: "app",
app: "oxylabs",
}
},
async run({steps, $}) {
const data = {
"geo_location": `United States`,
"url": `https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html`,
"source": `universal`,
}
return await axios($, {
method: "post",
url: `https://${this.oxylabs.$auth.api_name}.oxylabs.io/v1/queries`,
headers: {
"Content-Type": `application/json`,
},
auth: {
username: `${this.oxylabs.$auth.username}`,
password: `${this.oxylabs.$auth.password}`,
},
data,
})
},
})
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
news_api: {
type: "app",
app: "news_api",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://newsapi.org/v2/everything`,
headers: {
"X-Api-Key": `${this.news_api.$auth.api_key}`,
},
params: {
"q": `Computer Science`,
},
})
},
})