Integrate the RudderStack Transformation API with the Data Stores API

Setup the RudderStack Transformation API trigger to run a workflow which integrates with the Data Stores API. Pipedream's integration platform allows you to integrate RudderStack Transformation and Data Stores remarkably fast. Free for developers.

Popular RudderStack Transformation and Data Stores Actions#

Add or update a single record with the Data Stores API

Add or update a single record in your Pipedream Data Store.

Try it

Add or update multiple records with the Data Stores API

Add or update multiple records to your Pipedream Data Store.

Try it

Append to record with the Data Stores API

Append to a record in your data store Pipedream Data Store. If the record does not exist, a new record will be created in an array format.

Try it

Check for existence of key with the Data Stores API

Check if a key exists in your Pipedream Data Store or create one if it doesn't exist.

Try it

Delete a single record with the Data Stores API

Delete a single record in your Pipedream Data Store.

Try it

Overview of RudderStack Transformation#

The RudderStack Transformation API enables you to process and transform data before it's delivered to your data warehouse or other analytics tools. Within Pipedream, you can harness this API to customize the shape and structure of your data, apply business logic, filter out unnecessary information, or enrich data with additional attributes before forwarding it.

Connect RudderStack Transformation#

import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    rudderstack_transformation: {
      type: "app",
      app: "rudderstack_transformation",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://api.rudderstack.com/transformations`,
      auth: {
        username: `${this.rudderstack_transformation.$auth.email_address}`,
        password: `${this.rudderstack_transformation.$auth.personal_access_token}`,
      },
    })
  },
})

Overview of Data Stores#

Data Stores are a key-value store that allow you to persist state and share data across workflows. You can perform CRUD operations, enabling dynamic data management within your serverless architecture. Use it to save results from API calls, user inputs, or interim data; then read, update, or enrich this data in subsequent steps or workflows. Data Stores simplify stateful logic and cross-workflow communication, making them ideal for tracking process statuses, aggregating metrics, or serving as a simple configuration store.

Connect Data Stores#

export default defineComponent({
  props: {
    myDataStore: {
      type: "data_store",
    },
  },
  async run({ steps, $ }) {
    await this.myDataStore.set("key_here","Any serializable JSON as the value")
    return await this.myDataStore.get("key_here")
  },
})