What do you want to automate

with Databricks and Neon Postgres?

Prompt, edit and deploy AI agents that connect to Databricks, Neon Postgres and 2,500+ other apps in seconds.

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Get Run Output with Databricks API on New Column from Neon Postgres API
Neon Postgres + Databricks
 
Try it
Get Run Output with Databricks API on New or Updated Row from Neon Postgres API
Neon Postgres + Databricks
 
Try it
Get Run Output with Databricks API on New Row Custom Query from Neon Postgres API
Neon Postgres + Databricks
 
Try it
Get Run Output with Databricks API on New Row from Neon Postgres API
Neon Postgres + Databricks
 
Try it
Get Run Output with Databricks API on New Table from Neon Postgres API
Neon Postgres + Databricks
 
Try it
New Column from the Neon Postgres API

Emit new event when a new column is added to a table. See the documentation

 
Try it
New or Updated Row from the Neon Postgres API

Emit new event when a row is added or modified. See the documentation

 
Try it
New Row from the Neon Postgres API

Emit new event when a new row is added to a table. See the documentation

 
Try it
New Row Custom Query from the Neon Postgres API

Emit new event when new rows are returned from a custom query that you provide. See the documentation

 
Try it
New Table from the Neon Postgres API

Emit new event when a new table is added to the database. See the documentation

 
Try it
Get Run Output with the Databricks API

Retrieve the output and metadata of a single task run. See the documentation

 
Try it
Delete Row(s) with the Neon Postgres API

Deletes a row or rows from a table. See the documentation

 
Try it
List Runs with the Databricks API

Lists all runs available to the user. See the documentation

 
Try it
Execute SQL Query with the Neon Postgres API

Execute a custom PostgreSQL query. See our docs to learn more about working with SQL in Pipedream.

 
Try it
Run Job Now with the Databricks API

Run a job now and return the id of the triggered run. See the documentation

 
Try it
Integrate the Databricks API with the Neon Postgres API
Setup the Databricks API trigger to run a workflow which integrates with the Neon Postgres API. Pipedream's integration platform allows you to integrate Databricks and Neon Postgres remarkably fast. Free for developers.

Overview of Databricks

The Databricks API allows you to interact programmatically with Databricks services, enabling you to manage clusters, jobs, notebooks, and other resources within Databricks environments. Through Pipedream, you can leverage these APIs to create powerful automations and integrate with other apps for enhanced data processing, transformation, and analytics workflows. This unlocks possibilities like automating cluster management, dynamically running jobs based on external triggers, and orchestrating complex data pipelines with ease.

Connect Databricks

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    databricks: {
      type: "app",
      app: "databricks",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://${this.databricks.$auth.domain}.cloud.databricks.com/api/2.0/preview/scim/v2/Me`,
      headers: {
        Authorization: `Bearer ${this.databricks.$auth.access_token}`,
      },
    })
  },
})

Connect Neon Postgres

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
import { axios } from "@pipedream/platform";
import { neon } from "@neondatabase/serverless";

export default defineComponent({
  props: {
    neon_postgres: {
      type: "app",
      app: "neon_postgres",
    }
  },
  async run({ steps, $ }) {

    const { host, port, user, password, database } = this.neon_postgres.$auth
    const connectionString = `postgresql://${user}:${password}@${host}:${port}/${database}`  
    
    const sql = neon(connectionString)
    const result = await sql`SELECT version()`
    const { version } = result[0]
    return version

  },
})

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo