with Bright Data and Smartproxy?
Extract search engine results using Bright Data SERP API. See the documentation
Send an API call to a URL and get the HTML back. Enables you to bypass anti-bot measures, manages proxies, and solves CAPTCHAs automatically for easier web data collection. See the documentation
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
bright_data: {
type: "app",
app: "bright_data",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.brightdata.com/customer/balance`,
headers: {
Authorization: `Bearer ${this.bright_data.$auth.api_key}`,
},
})
},
})
Smartproxy is a tool that grants you access to a vast pool of residential IPs, allowing you to scrape data, automate tasks, and bypass geolocation restrictions without getting blocked. It's valuable for tasks that require mimicking real user behavior and accessing web data with minimal footprint. On Pipedream, you can leverage the Smartproxy API to create workflows that automate these tasks, integrate with other services, and handle the data as needed, all in a serverless environment.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
smartproxy: {
type: "app",
app: "smartproxy",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://${this.smartproxy.$auth.api_type}.smartproxy.com/v2/sub-users`,
params: {
"api-key": `${this.smartproxy.$auth.api_key}`,
},
})
},
})