Integrate the BigML API with the Snowflake API

Setup the BigML API trigger to run a workflow which integrates with the Snowflake API. Pipedream's integration platform allows you to integrate BigML and Snowflake remarkably fast. Free for developers.

Popular Ways to Connect BigML with Snowflake#

Create Batch Prediction with BigML API on New Row from Snowflake API

Snowflake + BigML

Try it

Create Model with BigML API on New Row from Snowflake API

Snowflake + BigML

Try it

Create Source (Remote URL) with BigML API on New Row from Snowflake API

Snowflake + BigML

Try it

Create Batch Prediction with BigML API on New Query Results from Snowflake API

Snowflake + BigML

Try it

Create Model with BigML API on New Query Results from Snowflake API

Snowflake + BigML

Try it

Popular BigML and Snowflake Triggers#

New Row from the Snowflake API

Emit new event when a row is added to a table

Try it

New Query Results from the Snowflake API

Run a SQL query on a schedule, triggering a workflow for each row of results

Try it

Failed Task in Schema from the Snowflake API

Emit new events when a task fails in a database schema

Try it

New Model Created from the BigML API

Emit new event for every created model. See docs here.

Try it

New Prediction Made from the BigML API

Emit new event for every made prediction. See docs here.

Try it

Popular BigML and Snowflake Actions#

Create Batch Prediction with the BigML API

Create a batch prediction given a Supervised Model ID and a Dataset ID. See the docs.

Try it

Create Model with the BigML API

Create a model based on a given source ID, dataset ID, or model ID. See the docs.

Try it

Create Source (Remote URL) with the BigML API

Create a source with a provided remote URL that points to the data file that you want BigML to download for you. See the docs.

Try it

Insert Multiple Rows with the Snowflake API

Insert multiple rows into a table

Try it

Insert Single Row with the Snowflake API

Insert a row into a table

Try it

Overview of BigML#

The BigML API offers a suite of machine learning tools that enable the creation and management of datasets, models, predictions, and more. It's a powerful resource for developers looking to incorporate machine learning into their applications. Within Pipedream, you can leverage the BigML API to automate workflows, process data, and apply predictive analytics. By connecting BigML to other apps in Pipedream, you can orchestrate sophisticated data pipelines that react to events, perform analyses, and take action based on machine learning insights.

Connect BigML#

import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    bigml: {
      type: "app",
      app: "bigml",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://bigml.io/andromeda/source`,
      params: {
        username: `${this.bigml.$auth.username}`,
        api_key: `${this.bigml.$auth.api_key}`,
      },
    })
  },
})

Overview of Snowflake#

Snowflake offers a cloud database and related tools to help developers create robust, secure, and scalable data warehouses. See Snowflake's Key Concepts & Architecture.

Getting Started

1. Create a user, role and warehouse in Snowflake

Snowflake recommends you create a new user, role, and warehouse when you integrate a third-party tool like Pipedream. This way, you can control permissions via the user / role, and separate Pipedream compute and costs with the warehouse. You can do this directly in the Snowflake UI.

We recommend you create a read-only account if you only need to query Snowflake. If you need to insert data into Snowflake, add permissions on the appropriate objects after you create your user.

2. Enter those details in Pipedream

Visit https://pipedream.com/accounts. Click the button to Connect an App. Enter the required Snowflake account data.

You'll only need to connect your account once in Pipedream. You can connect this account to multiple workflows to run queries against Snowflake, insert data, and more.

3. Build your first workflow

Visit https://pipedream.com/new to build your first workflow. Pipedream workflows let you connect Snowflake with 1,000+ other apps. You can trigger workflows on Snowflake queries, sending results to Slack, Google Sheets, or any app that exposes an API. Or you can accept data from another app, transform it with Python, Node.js, Go or Bash code, and insert it into Snowflake.

Learn more at Pipedream University.

Connect Snowflake#

import { promisify } from 'util'
import snowflake from 'snowflake-sdk'

export default defineComponent({
  props: {
    snowflake: {
      type: "app",
      app: "snowflake",
    }
  },
  async run({steps, $}) {
    const connection = snowflake.createConnection({
      ...this.snowflake.$auth,
      application: "PIPEDREAM_PIPEDREAM",
    })
    const connectAsync = promisify(connection.connect)
    await connectAsync()
    
    async function connExecuteAsync(options) {
      return new Promise((resolve, reject) => {
        connection.execute({
          ...options,
          complete: function(err, stmt, rows) {
            if (err) {
              reject(err)
            } else {
              resolve({stmt, rows})
            }
          }
        })
      })
    }
    
    // See https://docs.snowflake.com/en/user-guide/nodejs-driver-use.html#executing-statements
    const { rows } = await connExecuteAsync({
      sqlText: `SELECT CURRENT_TIMESTAMP()`,
    })
    return rows
  },
})