Create Team with Appwrite API on New Usage Monitor from Snowflake API

Pipedream makes it easy to connect APIs for Appwrite, Snowflake and 2,400+ other apps remarkably fast.

Trigger workflow on

New Usage Monitor from the Snowflake API

Next, do this

Create Team with the Appwrite API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a Snowflake trigger and Appwrite action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Usage Monitor trigger
1. Connect your Snowflake account
2. Configure timer
3. Optional- Configure Warehouse
4. Optional- Configure Database Name
5. Optional- Configure Username
6. Optional- Configure Role
7. Optional- Configure Schema
8. Optional- Configure Total Elapsed Time
9. Optional- Configure Bytes Scanned
10. Optional- Configure Rows Produced
11. Optional- Configure Compilation Time
12. Optional- Configure Execution Time
13. Optional- Configure Queued Provisioning Time
14. Optional- Configure Queue Repair Time
15. Optional- Configure Queued Overload Time
16. Optional- Configure Transaction Blocked Time
17. Optional- Configure Credit Used Cloud Services
Configure the Create Team action
1. Connect your Appwrite account
2. Configure Team ID
3. Configure Name
4. Optional- Configure Roles
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Usage Monitor on Snowflake

Description:Emit new event when a query is executed in the specified params

Version:0.1.2

Key:snowflake-usage-monitor

View on GitHub

Snowflake Overview#

Snowflake offers a cloud database and related tools to help developers create robust, secure, and scalable data warehouses. See Snowflake's Key Concepts & Architecture.

Getting Started

1. Create a user, role and warehouse in Snowflake

Snowflake recommends you create a new user, role, and warehouse when you integrate a third-party tool like Pipedream. This way, you can control permissions via the user / role, and separate Pipedream compute and costs with the warehouse. You can do this directly in the Snowflake UI.

We recommend you create a read-only account if you only need to query Snowflake. If you need to insert data into Snowflake, add permissions on the appropriate objects after you create your user.

2. Enter those details in Pipedream

Visit https://pipedream.com/accounts. Click the button to Connect an App. Enter the required Snowflake account data.

You'll only need to connect your account once in Pipedream. You can connect this account to multiple workflows to run queries against Snowflake, insert data, and more.

3. Build your first workflow

Visit https://pipedream.com/new to build your first workflow. Pipedream workflows let you connect Snowflake with 1,000+ other apps. You can trigger workflows on Snowflake queries, sending results to Slack, Google Sheets, or any app that exposes an API. Or you can accept data from another app, transform it with Python, Node.js, Go or Bash code, and insert it into Snowflake.

Learn more at Pipedream University.

Trigger Code#

import { DEFAULT_POLLING_SOURCE_TIMER_INTERVAL } from "@pipedream/platform";
import snowflake from "../../snowflake.app.mjs";

export default {
  type: "source",
  key: "snowflake-usage-monitor",
  name: "New Usage Monitor",
  description: "Emit new event when a query is executed in the specified params",
  version: "0.1.2",
  dedupe: "unique",
  props: {
    snowflake,
    db: "$.service.db",
    timer: {
      description: "Watch for changes on this schedule",
      type: "$.interface.timer",
      default: {
        intervalSeconds: DEFAULT_POLLING_SOURCE_TIMER_INTERVAL,
      },
    },
    warehouse: {
      type: "string",
      label: "Warehouse",
      description: "The warehouse to monitor",
      optional: true,
    },
    database: {
      type: "string",
      label: "Database Name",
      description: "The name of the database to monitor",
      optional: true,
    },
    username: {
      type: "string",
      label: "Username",
      description: "The username to monitor",
      optional: true,
    },
    role: {
      type: "string",
      label: "Role",
      description: "The role to monitor",
      optional: true,
    },
    schema: {
      type: "string",
      label: "Schema",
      description: "The schema to monitor",
      optional: true,
    },
    totalElapsedTime: {
      type: "string",
      label: "Total Elapsed Time",
      description: "Show register where TOTAL_ELAPSED_TIME >= requested value",
      optional: true,
    },
    bytesScanned: {
      type: "string",
      label: "Bytes Scanned",
      description: "Show register where BYTES_SCANNED >= requested value",
      optional: true,
    },
    rowsProduced: {
      type: "string",
      label: "Rows Produced",
      description: "Show register where ROWS_PRODUCED >= requested value",
      optional: true,
    },
    compilationTime: {
      type: "string",
      label: "Compilation Time",
      description: "Show register where COMPILATION_TIME >= requested value",
      optional: true,
    },
    executionTime: {
      type: "string",
      label: "Execution Time",
      description: "Show register where EXECUTION_TIME >= requested value",
      optional: true,
    },
    queuedProvisioningTime: {
      type: "string",
      label: "Queued Provisioning Time",
      description: "Show register where QUEUED_PROVISIONING_TIME >= requested value",
      optional: true,
    },
    queueRepairTime: {
      type: "string",
      label: "Queue Repair Time",
      description: "Show register where QUEUE_REPAIR_TIME >= requested value",
      optional: true,
    },
    queuedOverloadTime: {
      type: "string",
      label: "Queued Overload Time",
      description: "Show register where QUEUED_OVERLOAD_TIME >= requested value",
      optional: true,
    },
    transactionBlockedTime: {
      type: "string",
      label: "Transaction Blocked Time",
      description: "Show register where TRANSACTION_BLOCKED_TIME >= requested value",
      optional: true,
    },
    creditsUsedCloudServices: {
      type: "string",
      label: "Credit Used Cloud Services",
      description: "Show register where CREDITS_USED_CLOUD_SERVICES >= requested value",
      optional: true,
    },
  },
  methods: {
    updateLastExecutionTime() {
      this.db.set("lastExecutionTime", Date.now());
    },
    getLastExecutionTime() {
      return this.db.get("lastExecutionTime");
    },
    getSqlStatement() {
      const whereClausules = [];
      const binds = [];

      if (this.database) {
        whereClausules.push("and DATABASE_NAME = ?");
        binds.push(this.database);
      }

      if (this.warehouse) {
        whereClausules.push("and WAREHOUSE_NAME = ?");
        binds.push(this.warehouse);
      }

      if (this.username) {
        whereClausules.push("and user_name = ?");
        binds.push(this.username);
      }

      if (this.role) {
        whereClausules.push("and role_name = ?");
        binds.push(this.role);
      }

      if (this.schema) {
        whereClausules.push("and schema_name = ?");
        binds.push(this.schema);
      }

      if (this.totalElapsedTime) {
        whereClausules.push("and TOTAL_ELAPSED_TIME >= ?");
        binds.push(this.totalElapsedTime);
      }

      if (this.bytesScanned) {
        whereClausules.push("and BYTES_SCANNED >= ?");
        binds.push(this.bytesScanned);
      }

      if (this.rowsProduced) {
        whereClausules.push("and ROWS_PRODUCED >= ?");
        binds.push(this.rowsProduced);
      }

      if (this.compilationTime) {
        whereClausules.push("and COMPILATION_TIME >= ?");
        binds.push(this.compilationTime);
      }

      if (this.executionTime) {
        whereClausules.push("and EXECUTION_TIME >= ?");
        binds.push(this.executionTime);
      }

      if (this.queuedProvisioningTime) {
        whereClausules.push("and QUEUED_PROVISIONING_TIME >= ?");
        binds.push(this.queuedProvisioningTime);
      }

      if (this.queueRepairTime) {
        whereClausules.push("and QUEUE_REPAIR_TIME >= ?");
        binds.push(this.queueRepairTime);
      }

      if (this.queuedOverloadTime) {
        whereClausules.push("and QUEUED_OVERLOAD_TIME >= ?");
        binds.push(this.queuedOverloadTime);
      }

      if (this.transactionBlockedTime) {
        whereClausules.push("and TRANSACTION_BLOCKED_TIME >= ?");
        binds.push(this.transactionBlockedTime);
      }

      if (this.creditsUsedCloudServices) {
        whereClausules.push("and CREDITS_USED_CLOUD_SERVICES >= ?");
        binds.push(this.creditsUsedCloudServices);
      }

      return {
        sqlText: `select * from table(information_schema.query_history()) where START_TIME > ? ${whereClausules.join(" ")} order by start_time desc limit 50`,
        binds: [
          new Date(this.getLastExecutionTime()).toISOString(),
          ...binds,
        ],
      };
    },
    async fetchData() {
      return this.snowflake.executeQuery(this.getSqlStatement());
    },
    emit(event) {
      this.$emit(event, {
        summary: event.QUERY_TEXT,
        id: event.QUERY_ID,
        ts: event.START_TIME,
      });
    },
  },
  hooks: {
    async deploy() {
      this.updateLastExecutionTime();
    },
  },
  async run() {
    const rows = await this.fetchData();
    for await (const row of rows) {
      this.emit(row);
    }
    this.updateLastExecutionTime();
  },
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
Snowflake	`snowflake`	`app`	This component uses the Snowflake app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
	`timer`	`$.interface.timer`	Watch for changes on this schedule
Warehouse	`warehouse`	`string`	The warehouse to monitor
Database Name	`database`	`string`	The name of the database to monitor
Username	`username`	`string`	The username to monitor
Role	`role`	`string`	The role to monitor
Schema	`schema`	`string`	The schema to monitor
Total Elapsed Time	`totalElapsedTime`	`string`	Show register where TOTAL_ELAPSED_TIME >= requested value
Bytes Scanned	`bytesScanned`	`string`	Show register where BYTES_SCANNED >= requested value
Rows Produced	`rowsProduced`	`string`	Show register where ROWS_PRODUCED >= requested value
Compilation Time	`compilationTime`	`string`	Show register where COMPILATION_TIME >= requested value
Execution Time	`executionTime`	`string`	Show register where EXECUTION_TIME >= requested value
Queued Provisioning Time	`queuedProvisioningTime`	`string`	Show register where QUEUED_PROVISIONING_TIME >= requested value
Queue Repair Time	`queueRepairTime`	`string`	Show register where QUEUE_REPAIR_TIME >= requested value
Queued Overload Time	`queuedOverloadTime`	`string`	Show register where QUEUED_OVERLOAD_TIME >= requested value
Transaction Blocked Time	`transactionBlockedTime`	`string`	Show register where TRANSACTION_BLOCKED_TIME >= requested value
Credit Used Cloud Services	`creditsUsedCloudServices`	`string`	Show register where CREDITS_USED_CLOUD_SERVICES >= requested value

Trigger Authentication#

Snowflake uses API keys for authentication. When you connect your Snowflake account, Pipedream securely stores the keys so you can easily authenticate to Snowflake APIs in both code and no-code steps.

We recommend you create a read-only account if you only need to query Snowflake. If you need to insert data into Snowflake, add permissions on the appropriate objects after you create your user.

About Snowflake#

A data warehouse built for the cloud

Action#

Create Team on Appwrite

Description:Create a new team. [See the documentation](https://appwrite.io/docs/references/cloud/client-rest/teams#create)

Version:0.0.1

Key:appwrite-create-team

View on GitHub

Appwrite Overview#

Appwrite is a secure backend server geared towards providing developers with a set of easy-to-use APIs to manage core backend needs such as user authentication, databases, file storage, and more. With Appwrite's API, you can streamline backend development processes, ensuring quick and secure application development. Integrating Appwrite with Pipedream allows for the automation of processes like user management, data manipulation, and real-time updates cross-platform.

Action Code#

import app from "../../appwrite.app.mjs";

export default {
  key: "appwrite-create-team",
  name: "Create Team",
  description: "Create a new team. [See the documentation](https://appwrite.io/docs/references/cloud/client-rest/teams#create)",
  version: "0.0.1",
  type: "action",
  props: {
    app,
    teamId: {
      type: "string",
      label: "Team ID",
      description: "Choose a custom ID or generate a random ID with ID.unique(). Valid chars are a-z, A-Z, 0-9, period, hyphen, and underscore.",
    },
    name: {
      propDefinition: [
        app,
        "name",
      ],
      description: "Name of the team",
    },
    roles: {
      propDefinition: [
        app,
        "roles",
      ],
    },
  },
  async run({ $ }) {
    const response = await this.app.createTeam({
      $,
      data: {
        teamId: this.teamId,
        name: this.name,
        roles: this.roles,
      },
    });

    $.export("$summary", `Successfully created team '${response.name}'`);

    return response;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
Appwrite	`app`	`app`	This component uses the Appwrite app.
Team ID	`teamId`	`string`	Choose a custom ID or generate a random ID with ID.unique(). Valid chars are a-z, A-Z, 0-9, period, hyphen, and underscore.
Name	`name`	`string`	Name of the team
Roles	`roles`	`string[]`	Use this prop to set the roles in the team for the user who created it.