Databricks

Databricks is the lakehouse company, helping data teams solve the world’s toughest problems.

Integrate the Databricks API with the Amazon SES API

Setup the Databricks API trigger to run a workflow which integrates with the Amazon SES API. Pipedream's integration platform allows you to integrate Databricks and Amazon SES remarkably fast. Free for developers.

Get Run Output with the Databricks API

Retrieve the output and metadata of a single task run. See the documentation

 
Try it
Create Email Template with the Amazon SES API

Create a HTML or a plain text email template. See the docs

 
Try it
List Runs with the Databricks API

Lists all runs available to the user. See the documentation

 
Try it
Get Email Template with the Amazon SES API

Get an email template. See the docs

 
Try it
Run Job Now with the Databricks API

Run a job now and return the id of the triggered run. See the documentation

 
Try it

Overview of Databricks

The Databricks API allows you to interact programmatically with Databricks services, enabling you to manage clusters, jobs, notebooks, and other resources within Databricks environments. Through Pipedream, you can leverage these APIs to create powerful automations and integrate with other apps for enhanced data processing, transformation, and analytics workflows. This unlocks possibilities like automating cluster management, dynamically running jobs based on external triggers, and orchestrating complex data pipelines with ease.

Connect Databricks

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    databricks: {
      type: "app",
      app: "databricks",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://${this.databricks.$auth.domain}.cloud.databricks.com/api/2.0/clusters/list`,
      headers: {
        Authorization: `Bearer ${this.databricks.$auth.access_token}`,
      },
    })
  },
})

Overview of Amazon SES

Amazon Simple Email Service (SES) is a powerful cloud-based email sending service designed to help digital marketers and application developers send marketing, notification, and transactional emails. With the SES API, you can reliably send emails at scale, manage sender reputations, view email sending statistics, and maintain a high deliverability rate. Leveraging Pipedream's capabilities, you can integrate SES seamlessly into serverless workflows, automate email responses based on triggers from other apps, and analyze the effectiveness of your email campaigns by connecting to data analytics platforms.

Connect Amazon SES

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
module.exports = defineComponent({
  props: {
    amazon_ses: {
      type: "app",
      app: "amazon_ses",
    }
  },
  async run({steps, $}) {
    const AWS = require("aws-sdk")
    const { accessKeyId, secretAccessKey } = this.amazon_ses.$auth
    
    const ses = new AWS.SES({
      accessKeyId, 
      secretAccessKey,
      region: 'us-east-1',
    })
    
    const sesParams = {
      Destination: {
        ToAddresses: ["<your email here>"],
      }, 
      Message: {
        Body: {
          Html: {
            Charset: "UTF-8", 
            Data: "<h1>This is a test</h1>",
          }, 
            Text: {
            Charset: "UTF-8", 
            Data: "This is a test",
          }
        }, 
        Subject: {
          Charset: "UTF-8", 
          Data: "Test email",
        }
      },
      Source: "<your from address here", 
    };
    
    this.resp = await ses.sendEmail(sesParams).promise()
  },
})