Insert Single Row with Snowflake API on New Log Data from Mailgun API

Pipedream makes it easy to connect APIs for Snowflake, Mailgun and 2,400+ other apps remarkably fast.

Trigger workflow on

New Log Data from the Mailgun API

Next, do this

Insert Single Row with the Snowflake API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a Mailgun trigger and Snowflake action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Log Data trigger
1. Connect your Mailgun account
2. Select a Domain Name
3. Configure Polling schedule
Configure the Insert Single Row action
1. Connect your Snowflake account
2. Select a Database
3. Select a Schema
4. Select a Table Name
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Log Data on Mailgun

Description:Emit new event when new data is logged in Mailgun's Control Panel. Occurs for most actions within the associated Mailgun account.

Version:0.0.3

Key:mailgun-new-log-data

View on GitHub

Mailgun Overview#

The Mailgun API on Pipedream is a potent tool for automating email operations without the overhead of managing a full-fledged email server. It offers capabilities to send, receive, track, and store emails with ease. With Pipedream's serverless platform, you can trigger workflows using Mailgun events, such as inbound emails or delivery status changes, and connect them to hundreds of other services to streamline communication, marketing, and notification systems within your ecosystem.

Trigger Code#

import common from "../common/timer-based.mjs";

export default {
  ...common,
  key: "mailgun-new-log-data",
  name: "New Log Data",
  type: "source",
  description: "Emit new event when new data is logged in Mailgun's Control Panel. Occurs for most actions within the associated Mailgun account.",
  version: "0.0.3",
  dedupe: "unique",
  methods: {
    ...common.methods,
    _getLastSeenTime() {
      return this.db.get("lastSeenTime");
    },
    _setLastSeenTime(lastSeenTime) {
      this.db.set("lastSeenTime", lastSeenTime);
    },
    generateMeta(payload) {
      return {
        id: payload.id,
        summary: `[${payload["log-level"]}] ${payload.event}`,
        ts: payload.timestamp,
      };
    },
    async getLatestEvents(page = null, limit = 300, ascending = "yes") {
      const date = new Date();
      if (ascending === "yes") {
        date.setDate(date.getDate() - 1);
      } else {
        date.setDate(date.getDate());
      }
      const config = {
        begin: Math.floor(date.valueOf() / 1000),
        ascending,
        limit,
      };
      if (page) {
        config.page = page;
      }
      return this.mailgun.api("events").get(this.domain, config);
    },
  },
  hooks: {
    async deploy() {
      // Emit sample events on the first run during deploy
      let lastSeenTime = this._getLastSeenTime();
      const { items } = await this.getLatestEvents(null, 5, "no");
      if (items.length === 0) {
        return;
      }
      for (let item of items) {
        if (item.timestamp <= lastSeenTime) {
          continue;
        }
        this._setLastSeenTime(item.timestamp);
        this.$emit(item, this.generateMeta(item));
      }
    },
  },
  async run() {
    let result = {
      items: [],
      pages: {
        next: {
          id: null,
        },
      },
    };
    while (true) {
      result = await this.getLatestEvents(result.pages.next.number, 300);
      if (result.items.length === 0) {
        return;
      }
      const lastSeenTime = this._getLastSeenTime();
      for (let item of result.items) {
        if (item.timestamp <= lastSeenTime) {
          continue;
        }
        this._setLastSeenTime(item.timestamp);
        this.$emit(item, this.generateMeta(item));
      }
    }
  },
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
Mailgun	`mailgun`	`app`	This component uses the Mailgun app.
Domain Name	`domain`	`string`	Select a value from the drop down menu.
Polling schedule	`timer`	`$.interface.timer`	Pipedream polls Mailgun for events on this schedule.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.

Trigger Authentication#

Mailgun uses API keys for authentication. When you connect your Mailgun account, Pipedream securely stores the keys so you can easily authenticate to Mailgun APIs in both code and no-code steps.

About Mailgun#

Mailgun is an email automation service built for developers. Powerful transactional email APIs enable you to send, receive, and track emails.

Action#

Insert Single Row on Snowflake

Description:Insert a row into a table

Version:1.1.2

Key:snowflake-insert-row

View on GitHub

Snowflake Overview#

Snowflake offers a cloud database and related tools to help developers create robust, secure, and scalable data warehouses. See Snowflake's Key Concepts & Architecture.

Getting Started

1. Create a user, role and warehouse in Snowflake

Snowflake recommends you create a new user, role, and warehouse when you integrate a third-party tool like Pipedream. This way, you can control permissions via the user / role, and separate Pipedream compute and costs with the warehouse. You can do this directly in the Snowflake UI.

We recommend you create a read-only account if you only need to query Snowflake. If you need to insert data into Snowflake, add permissions on the appropriate objects after you create your user.

2. Enter those details in Pipedream

Visit https://pipedream.com/accounts. Click the button to Connect an App. Enter the required Snowflake account data.

You'll only need to connect your account once in Pipedream. You can connect this account to multiple workflows to run queries against Snowflake, insert data, and more.

3. Build your first workflow

Visit https://pipedream.com/new to build your first workflow. Pipedream workflows let you connect Snowflake with 1,000+ other apps. You can trigger workflows on Snowflake queries, sending results to Slack, Google Sheets, or any app that exposes an API. Or you can accept data from another app, transform it with Python, Node.js, Go or Bash code, and insert it into Snowflake.

Learn more at Pipedream University.

Action Code#

import snowflake from "../../snowflake.app.mjs";

export default {
  type: "action",
  key: "snowflake-insert-row",
  name: "Insert Single Row",
  description: "Insert a row into a table",
  version: "1.1.2",
  props: {
    snowflake,
    database: {
      propDefinition: [
        snowflake,
        "database",
      ],
    },
    schema: {
      propDefinition: [
        snowflake,
        "schema",
        (c) =>  ({
          database: c.database,
        }),
      ],
    },
    tableName: {
      propDefinition: [
        snowflake,
        "tableName",
        (c) => ({
          database: c.database,
          schema: c.schema,
        }),
      ],
      description: "The table where you want to add a new row",
      reloadProps: true,
    },
  },
  async additionalProps() {
    const props = {};
    // Once a user selects the table, display the columns as additional props
    if (this.tableName) {
      const fields = await this.snowflake.listFieldsForTable(this.tableName);
      const defaultValue = {};
      for (const field of fields) {
        defaultValue[field.name] = "";
      }
      props["values"] = {
        type: "object",
        label: "Values",
        description: "Enter the values for each column",
        default: defaultValue,
      };
    }
    return props;
  },
  async run({ $ }) {
    const response = await this.snowflake.insertRow(this.tableName, this.values);
    $.export("$summary", `Successfully inserted row in ${this.tableName}`);
    return response;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
Snowflake	`snowflake`	`app`	This component uses the Snowflake app.
Database	`database`	`string`	Select a value from the drop down menu.
Schema	`schema`	`string`	Select a value from the drop down menu.
Table Name	`tableName`	`string`	Select a value from the drop down menu.

Action Authentication#

Snowflake uses API keys for authentication. When you connect your Snowflake account, Pipedream securely stores the keys so you can easily authenticate to Snowflake APIs in both code and no-code steps.

We recommend you create a read-only account if you only need to query Snowflake. If you need to insert data into Snowflake, add permissions on the appropriate objects after you create your user.

About Snowflake#

A data warehouse built for the cloud

More Ways to Connect Snowflake + Mailgun#

Other Popular Integrations#

Insert Row with Snowflake API on New Bounce from Mailgun API

Mailgun + Snowflake