What do you want to automate

with Databricks and RudderStack Transformation?

Prompt, edit and deploy AI agents that connect to Databricks, RudderStack Transformation and 3,000+ other apps in seconds.

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Cancel All Runs with the Databricks API

Cancel all active runs for a job. The runs are canceled asynchronously, so it doesn't prevent new runs from being started. See the documentation

 
Try it
Cancel Run with the Databricks API

Cancel a job run. The run is canceled asynchronously, so it may still be running when this request completes. See the documentation

 
Try it
Create Endpoint with the Databricks API

Create a new vector search endpoint. See the documentation

 
Try it
Create Job with the Databricks API

Create a job. See the documentation

 
Try it
Create SQL Warehouse with the Databricks API

Creates a new SQL Warehouse in Databricks. See the documentation

 
Try it
Integrate the Databricks API with the RudderStack Transformation API
Setup the Databricks API trigger to run a workflow which integrates with the RudderStack Transformation API. Pipedream's integration platform allows you to integrate Databricks and RudderStack Transformation remarkably fast. Free for developers.

Overview of Databricks

The Databricks API allows you to interact programmatically with Databricks services, enabling you to manage clusters, jobs, notebooks, and other resources within Databricks environments. Through Pipedream, you can leverage these APIs to create powerful automations and integrate with other apps for enhanced data processing, transformation, and analytics workflows. This unlocks possibilities like automating cluster management, dynamically running jobs based on external triggers, and orchestrating complex data pipelines with ease.

Connect Databricks

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    databricks: {
      type: "app",
      app: "databricks",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://${this.databricks.$auth.domain}.cloud.databricks.com/api/2.0/preview/scim/v2/Me`,
      headers: {
        Authorization: `Bearer ${this.databricks.$auth.access_token}`,
      },
    })
  },
})

Overview of RudderStack Transformation

The RudderStack Transformation API enables you to process and transform data before it's delivered to your data warehouse or other analytics tools. Within Pipedream, you can harness this API to customize the shape and structure of your data, apply business logic, filter out unnecessary information, or enrich data with additional attributes before forwarding it.

Connect RudderStack Transformation

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    rudderstack_transformation: {
      type: "app",
      app: "rudderstack_transformation",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://api.rudderstack.com/transformations`,
      auth: {
        username: `${this.rudderstack_transformation.$auth.email_address}`,
        password: `${this.rudderstack_transformation.$auth.personal_access_token}`,
      },
    })
  },
})

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo