Integrate the Oxylabs API with the Data Stores API

Setup the Oxylabs API trigger to run a workflow which integrates with the Data Stores API. Pipedream's integration platform allows you to integrate Oxylabs and Data Stores remarkably fast. Free for developers.

Popular Oxylabs and Data Stores Actions#

Add or update a single record with the Data Stores API

Add or update a single record in your Pipedream Data Store.

Try it

Add or update multiple records with the Data Stores API

Add or update multiple records to your Pipedream Data Store.

Try it

Append to record with the Data Stores API

Append to a record in your data store Pipedream Data Store. If the record does not exist, a new record will be created in an array format.

Try it

Check for existence of key with the Data Stores API

Check if a key exists in your Pipedream Data Store or create one if it doesn't exist.

Try it

Delete a single record with the Data Stores API

Delete a single record in your Pipedream Data Store.

Try it

Overview of Oxylabs#

The Oxylabs API provides robust tools for web data extraction, enabling you to gather vast amounts of data efficiently from various sources across the web. With Pipedream's serverless platform, you can harness this power to create automated workflows that trigger on specific events, process the data, and connect to other services. Whether you're monitoring brand sentiment, tracking prices, or conducting market research, integrating Oxylabs with Pipedream can significantly streamline your data collection and analysis tasks.

Connect Oxylabs#

import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    oxylabs: {
      type: "app",
      app: "oxylabs",
    }
  },
  async run({steps, $}) {
    const data = {
      "geo_location": `United States`,
      "url": `https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html`,
      "source": `universal`,
    }
    return await axios($, {
      method: "post",
      url: `https://${this.oxylabs.$auth.api_name}.oxylabs.io/v1/queries`,
      headers: {
        "Content-Type": `application/json`,
      },
      auth: {
        username: `${this.oxylabs.$auth.username}`,
        password: `${this.oxylabs.$auth.password}`,
      },
      data,
    })
  },
})

Overview of Data Stores#

Data Stores are a key-value store that allow you to persist state and share data across workflows. You can perform CRUD operations, enabling dynamic data management within your serverless architecture. Use it to save results from API calls, user inputs, or interim data; then read, update, or enrich this data in subsequent steps or workflows. Data Stores simplify stateful logic and cross-workflow communication, making them ideal for tracking process statuses, aggregating metrics, or serving as a simple configuration store.

Connect Data Stores#

export default defineComponent({
  props: {
    myDataStore: {
      type: "data_store",
    },
  },
  async run({ steps, $ }) {
    await this.myDataStore.set("key_here","Any serializable JSON as the value")
    return await this.myDataStore.get("key_here")
  },
})