Simple and powerful web scraping API with automated proxies rotation and Chrome JS rendering
Add or update a single record in your Pipedream Data Store.
Add or update multiple records to your Pipedream Data Store.
Append to a record in your data store Pipedream Data Store. If the record does not exist, a new record will be created in an array format.
Check if a key exists in your Pipedream Data Store or create one if it doesn't exist.
WebScraping.AI is an API designed to make it easy to access and extract online
content from websites. Using the WebScraping.AI API, you can quickly and easily
build a range of automated data retrieval applications, such as:
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
webscraping_ai: {
type: "app",
app: "webscraping_ai",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.webscraping.ai/account`,
params: {
api_key: `${this.webscraping_ai.$auth.api_key}`,
},
})
},
})
With the Data Stores API, you can build applications that:
export default defineComponent({
props: {
myDataStore: {
type: "data_store",
},
},
async run({ steps, $ }) {
await this.myDataStore.set("key_here","Any serializable JSON as the value")
return await this.myDataStore.get("key_here")
},
})