DataTrails (formerly RKVST)
DataTrails (formerly RKVST is an API-first platform to add provenance and verify the authenticity of any digital content.)
Integrate the DataTrails (formerly RKVST) API with the Snowflake API
Setup the DataTrails (formerly RKVST) API trigger to run a workflow which integrates with the Snowflake API. Pipedream's integration platform allows you to integrate DataTrails (formerly RKVST) and Snowflake remarkably fast. Free for developers.
Popular Ways to Connect DataTrails (formerly RKVST) with Snowflake#
Popular DataTrails (formerly RKVST) and Snowflake Triggers#
Run a SQL query on a schedule, triggering a workflow for each row of results
Emit new event when a new asset is created.
Emit new event for each new activity related to any asset within the platform. Note that event only emitted when it is created by the API or Pipedream DataTrails action: Create new Event.
Popular DataTrails (formerly RKVST) and Snowflake Actions#
Allows for the addition of a new asset into the RKVST system. See the documentation
Create a new event based on an asset. See the documentation
Overview of DataTrails (formerly RKVST)#
The DataTrails API, formerly known as RKVST, is designed to track the provenance and integrity of digital assets across their lifecycle. With this API, you can create an immutable record of actions, decisions, and processes that affect any asset, thereby providing an auditable trail. Leveraging Pipedream, you can automate workflows that require secure, verifiable, and traceable asset history. You can react to events in real-time, integrate with other services, and trigger actions based on asset changes or compliance checks.
Connect DataTrails (formerly RKVST)#
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
rkvst: {
type: "app",
app: "rkvst",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://app.datatrails.ai/archivist/v2/assets`,
headers: {
Authorization: `Bearer ${this.rkvst.$auth.oauth_access_token}`,
},
})
},
})
Overview of Snowflake#
Snowflake offers a cloud database and related tools to help developers create robust, secure, and scalable data warehouses. See Snowflake's Key Concepts & Architecture.
Getting Started
1. Create a user, role and warehouse in Snowflake
Snowflake recommends you create a new user, role, and warehouse when you integrate a third-party tool like Pipedream. This way, you can control permissions via the user / role, and separate Pipedream compute and costs with the warehouse. You can do this directly in the Snowflake UI.
We recommend you create a read-only account if you only need to query Snowflake. If you need to insert data into Snowflake, add permissions on the appropriate objects after you create your user.
2. Enter those details in Pipedream
Visit https://pipedream.com/accounts. Click the button to Connect an App. Enter the required Snowflake account data.
You'll only need to connect your account once in Pipedream. You can connect this account to multiple workflows to run queries against Snowflake, insert data, and more.
3. Build your first workflow
Visit https://pipedream.com/new to build your first workflow. Pipedream workflows let you connect Snowflake with 1,000+ other apps. You can trigger workflows on Snowflake queries, sending results to Slack, Google Sheets, or any app that exposes an API. Or you can accept data from another app, transform it with Python, Node.js, Go or Bash code, and insert it into Snowflake.
Learn more at Pipedream University.
Connect Snowflake#
import { promisify } from 'util'
import snowflake from 'snowflake-sdk'
export default defineComponent({
props: {
snowflake: {
type: "app",
app: "snowflake",
}
},
async run({steps, $}) {
const connection = snowflake.createConnection({
...this.snowflake.$auth,
application: "PIPEDREAM_PIPEDREAM",
})
const connectAsync = promisify(connection.connect)
await connectAsync()
async function connExecuteAsync(options) {
return new Promise((resolve, reject) => {
connection.execute({
...options,
complete: function(err, stmt, rows) {
if (err) {
reject(err)
} else {
resolve({stmt, rows})
}
}
})
})
}
// See https://docs.snowflake.com/en/user-guide/nodejs-driver-use.html#executing-statements
const { rows } = await connExecuteAsync({
sqlText: `SELECT CURRENT_TIMESTAMP()`,
})
return rows
},
})