with Database and ZenRows?
Scrape HTML of the URL with CSS Selectors. See the documentation
The Database API on Pipedream allows users to execute SQL commands directly within workflows, enabling rich and dynamic data manipulation and storage. It supports PostgreSQL, MySQL, and SQLite, making it a versatile option for managing data across various database systems. With this API, users can perform tasks such as data insertion, querying, updates, and deletions, directly within their automations, facilitating real-time data processing and integration across multiple platforms.
import postgresql from "@pipedream/postgresql";
export default {
props: {
postgresql,
sql: {
type: "sql",
auth: {
app: "postgresql",
},
label: "PostreSQL Query",
},
},
async run({ $ }) {
const args = this.postgresql.executeQueryAdapter(this.sql);
const data = await this.postgresql.executeQuery(args);
return data;
},
};
ZenRows API specializes in web scraping and handles issues like CAPTCHAs, JavaScript rendering, and rotating proxies to ensure successful data extraction. In Pipedream, you can pair the ZenRows API with numerous other services to create automated workflows that respond to events, process and analyze scraped data, or even trigger actions based on the data collected. Whether you need to monitor changes on web pages, aggregate content for analysis, or feed scraped data into other applications, ZenRows' integration on Pipedream simplifies these tasks.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
zenrows: {
type: "app",
app: "zenrows",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.zenrows.com/v1/`,
params: {
apikey: `${this.zenrows.$auth.api_key}`,
url: `https://httpbin.io/anything`,
},
})
},
})