dbt is an intuitive, collaborative platform that lets you reliably transform data using SQL and Python code.
Go to siteThe dbt Cloud API allows users to initiate jobs, check on their status, and interact with dbt Cloud programmatically. On Pipedream, you can harness this functionality to automate workflows, such as triggering dbt runs, monitoring your data transformation jobs, and integrating dbt Cloud with other data services. By leveraging Pipedream's serverless platform, you can create custom workflows that act on dbt Cloud events or use the dbt Cloud API to manage your data transformation processes seamlessly.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
dbt: {
type: "app",
app: "dbt",
}
},
async run({steps, $}) {
const baseUrl = this.dbt.$auth.access_url || `https://${this.dbt.$auth.region}.com/`
return await axios($, {
url: `${baseUrl}api/v3/accounts/`,
headers: {
"Authorization": `Token ${this.dbt.$auth.api_key}`,
"Accept": `application/json`,
},
})
},
})
Trigger dbt Cloud Jobs from GitHub Pushes: Automatically start a dbt Cloud job when changes are pushed to specific branches in your GitHub repository. This ensures that your data transformations are always in sync with your latest codebase.
Monitor dbt Cloud Job Statuses and Alert via Slack: Set up a workflow on Pipedream that polls dbt Cloud job statuses at regular intervals. If a job fails or completes, send an alert with job details to a designated Slack channel, keeping your team informed in real time.
Sync dbt Cloud Metadata with Google Sheets: Extract metadata from completed dbt Cloud jobs and append it to a Google Sheet. This workflow can help you build a custom log or report, providing insights into your data transformation jobs without needing to access dbt Cloud's interface.
Retrieve information about an environment. See the documentation
Retrieve information about a run artifact. See the documentation
Trigger a specified job to begin running. See the documentation
dbt Cloud uses API keys for authentication. When you connect your dbt Cloud account, Pipedream securely stores the keys so you can easily authenticate to dbt Cloud APIs in both code and no-code steps.