A data warehouse built for the cloud
Run a SQL query on a schedule, triggering a workflow for each row of results
Emit an event for each new or modified record in a table
Emit an event for each new or modified record in a view
Create one or more records in a table by passing an array of objects containing field names and values as key/value pairs.
Retrieve records from a table with automatic pagination. Optionally sort and filter results.
Snowflake offers a cloud database and related tools to help developers create robust, secure, and scalable data warehouses. See Snowflake's Key Concepts & Architecture.
Snowflake recommends you create a new user, role, and warehouse when you integrate a third-party tool like Pipedream. This way, you can control permissions via the user / role, and separate Pipedream compute and costs with the warehouse. We recommend you create a read-only account if you only need to query Snowflake.
You'll only need to connect your account once in Pipedream. You can use this account to run queries against Snowflake, insert data, and more.
Visit [https://pipedream.com/new] to build your first workflow. Pipedream workflows let you connect Snowflake with 1,000+ other apps. You can trigger workflows on Snowflake queries, sending results to Slack, Google Sheets, or any app that exposes an API. Or you can accept data from another app, transform it with Python, Node.js, Go or Bash code, and insert it into Snowflake.
Learn more at Pipedream University.
import { promisify } from 'util'
import snowflake from 'snowflake-sdk'
export default defineComponent({
props: {
snowflake: {
type: "app",
app: "snowflake",
}
},
async run({steps, $}) {
const connection = snowflake.createConnection({
...this.snowflake.$auth,
application: "PIPEDREAM_PIPEDREAM",
})
const connectAsync = promisify(connection.connect)
await connectAsync()
async function connExecuteAsync(options) {
return new Promise((resolve, reject) => {
connection.execute({
...options,
complete: function(err, stmt, rows) {
if (err) {
reject(err)
} else {
resolve({stmt, rows})
}
}
})
})
}
// See https://docs.snowflake.com/en/user-guide/nodejs-driver-use.html#executing-statements
const { rows } = await connExecuteAsync({
sqlText: `SELECT CURRENT_TIMESTAMP()`,
})
return rows
},
})
Using the Airtable API, you can build applications that can:
module.exports = defineComponent({
props: {
airtable: {
type: "app",
app: "airtable",
},
baseId: {
type: "$.airtable.baseId",
appProp: "airtable",
},
tableId: {
type: "$.airtable.tableId",
baseIdProp: "baseId",
},
},
async run({steps, $}) {
const Airtable = require('airtable');
const base = new Airtable({apiKey: this.airtable.$auth.api_key}).base(this.baseId);
const data = []
await base(this.tableId).select({
// pass optional config parameters here
}).eachPage(function page(records, fetchNextPage) {
// This function (`page`) will get called for each page of records.
records.forEach(function(record) {
data.push(record._rawJson)
});
// To fetch the next page of records, call `fetchNextPage`.
// If there are more records, `page` will get called again.
// If there are no more records, `done` will get called.
fetchNextPage();
})
return data
},
})