Integrate the Oxylabs API with the Data Stores API

Setup the Oxylabs API trigger to run a workflow which integrates with the Data Stores API. Pipedream's integration platform allows you to integrate Oxylabs and Data Stores remarkably fast. Free for developers.

Popular Oxylabs and Data Stores Actions#

Add or update a single record with the Data Stores API

Add or update a single record in your Pipedream Data Store.

Try it

Add or update multiple records with the Data Stores API

Add or update multiple records to your Pipedream Data Store.

Try it

Append to record with the Data Stores API

Append to a record in your data store Pipedream Data Store. If the record does not exist, a new record will be created in an array format.

Try it

Check for existence of key with the Data Stores API

Check if a key exists in your Pipedream Data Store or create one if it doesn't exist.

Try it

Delete a single record with the Data Stores API

Delete a single record in your Pipedream Data Store.

Try it

Overview of Oxylabs#

The Oxylabs API provides robust tools for web data extraction, enabling you to gather vast amounts of data efficiently from various sources across the web. With Pipedream's serverless platform, you can harness this power to create automated workflows that trigger on specific events, process the data, and connect to other services. Whether you're monitoring brand sentiment, tracking prices, or conducting market research, integrating Oxylabs with Pipedream can significantly streamline your data collection and analysis tasks.

Connect Oxylabs#

import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    oxylabs: {
      type: "app",
      app: "oxylabs",
    }
  },
  async run({steps, $}) {
    const data = {
      "geo_location": `United States`,
      "url": `https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html`,
      "source": `universal`,
    }
    return await axios($, {
      method: "post",
      url: `https://${this.oxylabs.$auth.api_name}.oxylabs.io/v1/queries`,
      headers: {
        "Content-Type": `application/json`,
      },
      auth: {
        username: `${this.oxylabs.$auth.username}`,
        password: `${this.oxylabs.$auth.password}`,
      },
      data,
    })
  },
})

Overview of Data Stores#

With the Data Stores API, you can build applications that:

Store data for later retrieval
Retrieve data from a store
Update data in a store
Delete data from a store

Connect Data Stores#

export default defineComponent({
  props: {
    myDataStore: {
      type: "data_store",
    },
  },
  async run({ steps, $ }) {
    await this.myDataStore.set("key_here","Any serializable JSON as the value")
    return await this.myDataStore.get("key_here")
  },
})