Effortlessly Scrape the Web Data You Need. Quality data collection infrastructure for virtually every use case.
Emit new event when a new column is added to a table. See the documentation
Emit new event when a row is added or modified. See the documentation
Emit new event when a new row is added to a table. See the documentation
Emit new event when new rows are returned from a custom query that you provide. See the documentation
Emit new event when a new table is added to the database. See the documentation
Finds a row in a table via a custom query. See the documentation
Smartproxy is a tool that grants you access to a vast pool of residential IPs, allowing you to scrape data, automate tasks, and bypass geolocation restrictions without getting blocked. It's valuable for tasks that require mimicking real user behavior and accessing web data with minimal footprint. On Pipedream, you can leverage the Smartproxy API to create workflows that automate these tasks, integrate with other services, and handle the data as needed, all in a serverless environment.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
smartproxy: {
type: "app",
app: "smartproxy",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://${this.smartproxy.$auth.api_type}.smartproxy.com/v2/sub-users`,
params: {
"api-key": `${this.smartproxy.$auth.api_key}`,
},
})
},
})
On Pipedream, you can leverage the PostgreSQL app to create workflows that automate database operations, synchronize data across platforms, and react to database events in real-time. Think handling new row entries, updating records from webhooks, or even compiling reports on a set schedule. Pipedream's serverless platform provides a powerful way to connect PostgreSQL with a variety of apps, enabling you to create tailored automation that fits your specific needs.
import postgresql from "@pipedream/postgresql"
export default defineComponent({
props: {
postgresql,
},
async run({ steps, $ }) {
// Component source code:
// https://github.com/PipedreamHQ/pipedream/tree/master/components/postgresql
const queryObj = {
text: "SELECT NOW()",
values: [], // Ignored since query does not contain placeholders
};
return await this.postgresql.executeQuery(queryObj);
},
})