List Runs with Databricks API on New Pin Event from Pinterest API

Pipedream makes it easy to connect APIs for Databricks, Pinterest and 2,700+ other apps remarkably fast.

Trigger workflow on

New Pin Event from the Pinterest API

Next, do this

List Runs with the Databricks API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a Pinterest trigger and Databricks action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Pin Event trigger
1. Connect your Pinterest account
2. Configure timer
3. Select a Board ID
4. Optional- Select a Board Section ID
Configure the List Runs action
1. Connect your Databricks account
2. Optional- Select a Job
3. Optional- Configure Active Only?
4. Optional- Configure Max Results
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Pin Event on Pinterest

Description:Emit new events when new pins are created on a board or board section. [See the docs here](https://developers.pinterest.com/docs/api/v5/#operation/boards/list_pins) and [here](https://developers.pinterest.com/docs/api/v5/#operation/board_sections/list_pins)

Version:0.1.0

Key:pinterest-new-pin

View on GitHub

Pinterest Overview#

The Pinterest API opens a portal to interact programmatically with Pinterest's rich data, including boards, pins, and user information. By leveraging this API on Pipedream, you can automate actions like posting new pins, extracting pin data for analysis, and synchronizing Pinterest content with other platforms. The potential extends to marketing optimization, content management, and audience engagement, all automated and integrated within the Pipedream ecosystem.

Trigger Code#

import pinterest from "../../pinterest.app.mjs";
import common from "../common.mjs";

export default {
  key: "pinterest-new-pin",
  name: "New Pin Event",
  description: "Emit new events when new pins are created on a board or board section. [See the docs here](https://developers.pinterest.com/docs/api/v5/#operation/boards/list_pins) and [here](https://developers.pinterest.com/docs/api/v5/#operation/board_sections/list_pins)",
  version: "0.1.0",
  type: "source",
  ...common,
  props: {
    pinterest,
    ...common.props,
    boardId: {
      propDefinition: [
        pinterest,
        "boardId",
      ],
    },
    boardSectionId: {
      propDefinition: [
        pinterest,
        "boardSectionId",
        (configuredProps) => ({
          boardId: configuredProps.boardId,
        }),
      ],
    },
  },
  methods: {
    ...common.methods,
    getResourceFn() {
      return this.pinterest.getPins;
    },
    getResourceFnArgs() {
      return {
        boardId: this.boardId,
        boardSectionId: this.boardSectionId,
      };
    },
    getSummary(item) {
      return `New pin ${item.title} (ID:${item.id})`;
    },
    compareFn(item) {
      return new Date(item.created_at).getTime() > this.getLastFetchTime();
    },
  },
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
Pinterest	`pinterest`	`app`	This component uses the Pinterest app.
	`timer`	`$.interface.timer`
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
Board ID	`boardId`	`string`	Select a value from the drop down menu.
Board Section ID	`boardSectionId`	`string`	Select a value from the drop down menu.

Trigger Authentication#

Pinterest uses OAuth authentication. When you connect your Pinterest account, Pipedream will open a popup window where you can sign into Pinterest and grant Pipedream permission to connect to your account. Pipedream securely stores and automatically refreshes the OAuth tokens so you can easily authenticate any Pinterest API.

Pipedream requests the following authorization scopes when you connect your account:

boards:readboards:read_secretboards:writeboards:write_secretpins:readpins:read_secretpins:writepins:write_secretuser_accounts:read

About Pinterest#

Pinterest is a visual discovery engine for finding ideas like recipes, home and style inspiration, and more.

Action#

List Runs on Databricks

Description:Lists all runs available to the user. [See the documentation](https://docs.databricks.com/en/workflows/jobs/jobs-2.0-api.html#runs-list)

Version:0.0.1

Key:databricks-list-runs

View on GitHub

Databricks Overview#

The Databricks API allows you to interact programmatically with Databricks services, enabling you to manage clusters, jobs, notebooks, and other resources within Databricks environments. Through Pipedream, you can leverage these APIs to create powerful automations and integrate with other apps for enhanced data processing, transformation, and analytics workflows. This unlocks possibilities like automating cluster management, dynamically running jobs based on external triggers, and orchestrating complex data pipelines with ease.

Action Code#

import databricks from "../../databricks.app.mjs";

export default {
  key: "databricks-list-runs",
  name: "List Runs",
  description: "Lists all runs available to the user. [See the documentation](https://docs.databricks.com/en/workflows/jobs/jobs-2.0-api.html#runs-list)",
  version: "0.0.1",
  type: "action",
  props: {
    databricks,
    jobId: {
      propDefinition: [
        databricks,
        "jobId",
      ],
      optional: true,
    },
    activeOnly: {
      type: "boolean",
      label: "Active Only?",
      description: "Set to true to return only active runs",
      optional: true,
    },
    maxResults: {
      type: "integer",
      label: "Max Results",
      description: "Maximum number of runs to return",
      default: 100,
      optional: true,
    },
  },
  async run({ $ }) {
    const params = {
      job_id: this.jobId,
      active_only: this.activeOnly,
      limit: 100,
      offset: 0,
    };
    const allRuns = [];
    let total = 0;

    do {
      const { runs } = await this.databricks.listRuns({
        params,
        $,
      });
      if (!runs?.length) {
        break;
      }
      allRuns.push(...runs);
      params.offset += params.limit;
      total = runs?.length;
    } while (total === params.limit && allRuns < this.maxResults);

    if (allRuns?.length > this.maxResults) {
      allRuns.length = this.maxResults;
    }

    $.export("$summary", `Successfully retrieved ${allRuns.length} run${allRuns.length === 1
      ? ""
      : "s"}.`);

    return allRuns;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
Databricks	`databricks`	`app`	This component uses the Databricks app.
Job	`jobId`	`string`	Select a value from the drop down menu.
Active Only?	`activeOnly`	`boolean`	Set to true to return only active runs
Max Results	`maxResults`	`integer`	Maximum number of runs to return

Action Authentication#

Databricks uses API keys for authentication. When you connect your Databricks account, Pipedream securely stores the keys so you can easily authenticate to Databricks APIs in both code and no-code steps.

To retrieve your Personal Access Token:

Sign in to your Databricks account, and open your Databricks workspace.
From your workspace, click on your username in the top right corner,
Go to “User Settings” > "Developer" > “Access tokens”

Your domain is 1234 if your Databricks instance URL is https://1234.cloud.databricks.com/, except for the Accounts API whose domain is account regardless of instance.