Databricks
Databricks is the lakehouse company, helping data teams solve the world’s toughest problems.
Integrate the Databricks API with the OpenAI (ChatGPT) API
Setup the Databricks API trigger to run a workflow which integrates with the OpenAI (ChatGPT) API. Pipedream's integration platform allows you to integrate Databricks and OpenAI (ChatGPT) remarkably fast. Free for developers.
Popular Ways to Connect Databricks with OpenAI (ChatGPT)#
Popular Databricks and OpenAI (ChatGPT) Triggers#
Emit new event when a new file is created in OpenAI. See the documentation
Emit new event when a new fine-tuning job is created in OpenAI. See the documentation
Emit new event every time a run changes its status. See the documentation
Popular Databricks and OpenAI (ChatGPT) Actions#
Retrieve the output and metadata of a single task run. See the documentation
The Chat API, using the gpt-3.5-turbo or gpt-4 model. See docs here
Run a job now and return the id of the triggered run. See the documentation
Overview of Databricks#
The Databricks API allows you to interact programmatically with Databricks services, enabling you to manage clusters, jobs, notebooks, and other resources within Databricks environments. Through Pipedream, you can leverage these APIs to create powerful automations and integrate with other apps for enhanced data processing, transformation, and analytics workflows. This unlocks possibilities like automating cluster management, dynamically running jobs based on external triggers, and orchestrating complex data pipelines with ease.
Connect Databricks#
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
databricks: {
type: "app",
app: "databricks",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://${this.databricks.$auth.domain}.cloud.databricks.com/api/2.0/clusters/list`,
headers: {
Authorization: `Bearer ${this.databricks.$auth.access_token}`,
},
})
},
})
Overview of OpenAI (ChatGPT)#
OpenAI provides a suite of powerful AI models through its API, enabling developers to integrate advanced natural language processing and generative capabilities into their applications. Here’s an overview of the services offered by OpenAI's API:
Use Python or Node.js code to make fully authenticated API requests with your OpenAI account:
Connect OpenAI (ChatGPT)#
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
openai: {
type: "app",
app: "openai",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.openai.com/v1/models`,
headers: {
Authorization: `Bearer ${this.openai.$auth.api_key}`,
},
})
},
})