Snowflake

A data warehouse built for the cloud

Integrate the Snowflake API with the Data Stores API

Setup the Snowflake API trigger to run a workflow which integrates with the Data Stores API. Pipedream's integration platform allows you to integrate Snowflake and Data Stores remarkably fast. Free for developers.

Add or update a single record with Data Stores API on New Row from Snowflake API
Snowflake + Data Stores
 
Try it
Add or update a single record with Data Stores API on Query Results from Snowflake API
Snowflake + Data Stores
 
Try it
Add or update multiple records with Data Stores API on New Row from Snowflake API
Snowflake + Data Stores
 
Try it
Add or update multiple records with Data Stores API on Query Results from Snowflake API
Snowflake + Data Stores
 
Try it
Delete a single record with Data Stores API on New Row from Snowflake API
Snowflake + Data Stores
 
Try it
New Query Results from the Snowflake API

Run a SQL query on a schedule, triggering a workflow for each row of results

 
Try it
New Row from the Snowflake API

Emit new event when a row is added to a table

 
Try it
Insert Multiple Rows with the Snowflake API

Insert multiple rows into a table

 
Try it
Add or update a single record with the Data Stores API

Add or update a single record in your Pipedream Data Store.

 
Try it
Insert Single Row with the Snowflake API

Insert a row into a table

 
Try it
Add or update multiple records with the Data Stores API

Add or update multiple records to your Pipedream Data Store.

 
Try it
Check for existence of key with the Data Stores API

Check if a key exists in your Pipedream Data Store or create one if it doesn't exist.

 
Try it

Overview of Snowflake

Snowflake offers a cloud database and related tools to help developers create robust, secure, and scalable data warehouses. See Snowflake's Key Concepts & Architecture.

Getting Started

1. Create a user, role and warehouse in Snowflake

Snowflake recommends you create a new user, role, and warehouse when you integrate a third-party tool like Pipedream. This way, you can control permissions via the user / role, and separate Pipedream compute and costs with the warehouse. We recommend you create a read-only account if you only need to query Snowflake.

2. Enter those details in Pipedream

  1. Visit https://pipedream.com/accounts
  2. Click the button to Connect an App
  3. Enter the required Snowflake data.

You'll only need to connect your account once in Pipedream. You can use this account to run queries against Snowflake, insert data, and more.

3. Build your first workflow

Visit [https://pipedream.com/new] to build your first workflow. Pipedream workflows let you connect Snowflake with 1,000+ other apps. You can trigger workflows on Snowflake queries, sending results to Slack, Google Sheets, or any app that exposes an API. Or you can accept data from another app, transform it with Python, Node.js, Go or Bash code, and insert it into Snowflake.

Learn more at Pipedream University.

Connect Snowflake

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
import { promisify } from 'util'
import snowflake from 'snowflake-sdk'

export default defineComponent({
  props: {
    snowflake: {
      type: "app",
      app: "snowflake",
    }
  },
  async run({steps, $}) {
    const connection = snowflake.createConnection({
      ...this.snowflake.$auth,
      application: "PIPEDREAM_PIPEDREAM",
    })
    const connectAsync = promisify(connection.connect)
    await connectAsync()
    
    async function connExecuteAsync(options) {
      return new Promise((resolve, reject) => {
        connection.execute({
          ...options,
          complete: function(err, stmt, rows) {
            if (err) {
              reject(err)
            } else {
              resolve({stmt, rows})
            }
          }
        })
      })
    }
    
    // See https://docs.snowflake.com/en/user-guide/nodejs-driver-use.html#executing-statements
    const { rows } = await connExecuteAsync({
      sqlText: `SELECT CURRENT_TIMESTAMP()`,
    })
    return rows
  },
})

Overview of Data Stores

With the Data Stores API, you can build applications that:

  • Store data for later retrieval
  • Retrieve data from a store
  • Update data in a store
  • Delete data from a store

Connect Data Stores

1
2
3
4
5
6
7
8
9
10
11
export default defineComponent({
  props: {
    myDataStore: {
      type: "data_store",
    },
  },
  async run({ steps, $ }) {
    await this.myDataStore.set("key_here","Any serializable JSON as the value")
    return await this.myDataStore.get("key_here")
  },
})