Integrate the Snowflake API with the AWS API

Setup the Snowflake API trigger to run a workflow which integrates with the AWS API. Pipedream's integration platform allows you to integrate Snowflake and AWS remarkably fast. Free for developers.

Popular Ways to Connect Snowflake with AWS#

CloudWatch Logs - Put Log Event with AWS API on New Row from Snowflake API

Snowflake + AWS

Try it

DynamoDB - Create Table with AWS API on New Row from Snowflake API

Snowflake + AWS

Try it

DynamoDB - Execute Statement with AWS API on New Row from Snowflake API

Snowflake + AWS

Try it

DynamoDB - Get Item with AWS API on New Row from Snowflake API

Snowflake + AWS

Try it

DynamoDB - Put Item with AWS API on New Row from Snowflake API

Snowflake + AWS

Try it

Popular Snowflake and AWS Triggers#

New Row from the Snowflake API

Emit new event when a row is added to a table

Try it

New Scheduled Tasks from the AWS API

Creates a Step Function State Machine to publish a message to an SNS topic at a specific timestamp. The SNS topic delivers the message to this Pipedream source, and the source emits it as a new event.

Try it

New Query Results from the Snowflake API

Run a SQL query on a schedule, triggering a workflow for each row of results

Try it

New SNS Messages from the AWS API

Creates an SNS topic in your AWS account. Messages published to this topic are emitted from the Pipedream source.

Try it

Failed Task in Schema from the Snowflake API

Emit new events when a task fails in a database schema

Try it

Popular Snowflake and AWS Actions#

Insert Multiple Rows with the Snowflake API

Insert multiple rows into a table

Try it

CloudWatch Logs - Put Log Event with the AWS API

Uploads a log event to the specified log stream. See docs

Try it

Insert Single Row with the Snowflake API

Insert a row into a table

Try it

DynamoDB - Create Table with the AWS API

Creates a new table to your account. See docs

Try it

DynamoDB - Execute Statement with the AWS API

This operation allows you to perform transactional reads or writes on data stored in DynamoDB, using PartiQL. See docs

Try it

Overview of Snowflake#

Snowflake offers a cloud database and related tools to help developers create robust, secure, and scalable data warehouses. See Snowflake's Key Concepts & Architecture.

Getting Started

1. Create a user, role and warehouse in Snowflake

Snowflake recommends you create a new user, role, and warehouse when you integrate a third-party tool like Pipedream. This way, you can control permissions via the user / role, and separate Pipedream compute and costs with the warehouse. You can do this directly in the Snowflake UI.

We recommend you create a read-only account if you only need to query Snowflake. If you need to insert data into Snowflake, add permissions on the appropriate objects after you create your user.

2. Enter those details in Pipedream

Visit https://pipedream.com/accounts. Click the button to Connect an App. Enter the required Snowflake account data.

You'll only need to connect your account once in Pipedream. You can connect this account to multiple workflows to run queries against Snowflake, insert data, and more.

3. Build your first workflow

Visit https://pipedream.com/new to build your first workflow. Pipedream workflows let you connect Snowflake with 1,000+ other apps. You can trigger workflows on Snowflake queries, sending results to Slack, Google Sheets, or any app that exposes an API. Or you can accept data from another app, transform it with Python, Node.js, Go or Bash code, and insert it into Snowflake.

Learn more at Pipedream University.

Connect Snowflake#

import { promisify } from 'util'
import snowflake from 'snowflake-sdk'

export default defineComponent({
  props: {
    snowflake: {
      type: "app",
      app: "snowflake",
    }
  },
  async run({steps, $}) {
    const connection = snowflake.createConnection({
      ...this.snowflake.$auth,
      application: "PIPEDREAM_PIPEDREAM",
    })
    const connectAsync = promisify(connection.connect)
    await connectAsync()
    
    async function connExecuteAsync(options) {
      return new Promise((resolve, reject) => {
        connection.execute({
          ...options,
          complete: function(err, stmt, rows) {
            if (err) {
              reject(err)
            } else {
              resolve({stmt, rows})
            }
          }
        })
      })
    }
    
    // See https://docs.snowflake.com/en/user-guide/nodejs-driver-use.html#executing-statements
    const { rows } = await connExecuteAsync({
      sqlText: `SELECT CURRENT_TIMESTAMP()`,
    })
    return rows
  },
})

Overview of AWS#

The AWS API unlocks endless possibilities for automation with Pipedream. With this powerful combo, you can manage your AWS services and resources, automate deployment workflows, process data, and react to events across your AWS infrastructure. Pipedream offers a serverless platform for creating workflows triggered by various events that can execute AWS SDK functions, making it an efficient tool to integrate, automate, and orchestrate tasks across AWS services and other apps.

Connect AWS#

import AWS from 'aws-sdk'

export default defineComponent({
  props: {
    aws: {
      type: "app",
      app: "aws",
    }
  },
  async run({steps, $}) {
    const { accessKeyId, secretAccessKey } = this.aws.$auth
    
    /* Now, pass the accessKeyId and secretAccessKey to the constructor for your desired service. For example:
    
    const dynamodb = new AWS.DynamoDB({
      accessKeyId, 
      secretAccessKey,
      region: 'us-east-1',
    })
    
    */
  },
})