Integrate the San Francisco Open Data - DataSF API with the Snowflake API

Setup the San Francisco Open Data - DataSF API trigger to run a workflow which integrates with the Snowflake API. Pipedream's integration platform allows you to integrate San Francisco Open Data - DataSF and Snowflake remarkably fast. Free for developers.

Start for free — no credit card required

Watch a demo

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Popular San Francisco Open Data - DataSF and Snowflake Triggers#

New Row from the Snowflake API

Emit new event when a row is added to a table

Try it

New Query Results from the Snowflake API

Run a SQL query on a schedule, triggering a workflow for each row of results

Try it

Failed Task in Schema from the Snowflake API

Emit new events when a task fails in a database schema

Try it

New Database from the Snowflake API

Emit new event when a database is created

Try it

New Deleted Role from the Snowflake API

Emit new event when a role is deleted

Try it

Popular San Francisco Open Data - DataSF and Snowflake Actions#

Execute SQL Query with the Snowflake API

Execute a custom Snowflake query. See our docs to learn more about working with SQL in Pipedream.

Try it

Insert Multiple Rows with the Snowflake API

Insert multiple rows into a table

Try it

Insert Single Row with the Snowflake API

Insert a row into a table

Try it

Query SQL Database with the Snowflake API

Execute a SQL Query. See our docs to learn more about working with SQL in Pipedream.

Try it

Overview of San Francisco Open Data - DataSF#

The San Francisco Open Data - DataSF API unlocks a wealth of government data spanning multiple domains such as transportation, housing, and public health. It provides developers with access to rich datasets, which can be integrated into applications to derive insights, inform decision-making, and power data-driven solutions. Pipedream's serverless platform amplifies this potential by enabling users to create automated workflows that leverage this data in concert with other apps and services.

Connect San Francisco Open Data - DataSF#

import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    san_francisco_open_data_datasf: {
      type: "app",
      app: "san_francisco_open_data_datasf",
    }
  },
  async run({steps, $}) {
    // Below, we fetch a range of COVID-19 case data from DataSF. You can
    // run this to see how the results are displayed on Pipedream, or modify it 
    // in any way to fetch data from another dataset or modify the Socrata 
    // query. See the docs below for Socrata docs and examples.
    
    // COVID-19 Cases Summarized by Date, Transmission and Case Disposition
    // https://dev.socrata.com/foundry/data.sfgov.org/tvq9-ec9w
    
    return await axios($, {
      url: `https://data.sfgov.org/resource/tvq9-ec9w.json`,
      headers: {
        "X-App-Token": `${this.san_francisco_open_data_datasf.$auth.app_token}`,
      },
      params: {
        "$where": `date between '2020-05-18T00:00:00' and '2020-05-20T00:00:00'`,
      },
    })
  },
})

Overview of Snowflake#

Snowflake offers a cloud database and related tools to help developers create robust, secure, and scalable data warehouses. See Snowflake's Key Concepts & Architecture.

Getting Started

1. Create a user, role and warehouse in Snowflake

Snowflake recommends you create a new user, role, and warehouse when you integrate a third-party tool like Pipedream. This way, you can control permissions via the user / role, and separate Pipedream compute and costs with the warehouse. You can do this directly in the Snowflake UI.

We recommend you create a read-only account if you only need to query Snowflake. If you need to insert data into Snowflake, add permissions on the appropriate objects after you create your user.

2. Enter those details in Pipedream

Visit https://pipedream.com/accounts. Click the button to Connect an App. Enter the required Snowflake account data.

You'll only need to connect your account once in Pipedream. You can connect this account to multiple workflows to run queries against Snowflake, insert data, and more.

3. Build your first workflow

Visit https://pipedream.com/new to build your first workflow. Pipedream workflows let you connect Snowflake with 1,000+ other apps. You can trigger workflows on Snowflake queries, sending results to Slack, Google Sheets, or any app that exposes an API. Or you can accept data from another app, transform it with Python, Node.js, Go or Bash code, and insert it into Snowflake.

Learn more at Pipedream University.

Connect Snowflake#

import snowflake from '@pipedream/snowflake';

export default defineComponent({
  props: {
    snowflake,
  },
  async run({ $ }) {
    // Component source code:
    // https://github.com/PipedreamHQ/pipedream/tree/master/components/snowflake
    
    return this.snowflake.executeQuery({
      sqlText: `SELECT CURRENT_TIMESTAMP()`,
      binds: [],
    });
  },
});

Start for free — no credit card required

Watch a demo