Google Cloud

The Google Cloud Platform, including BigQuery

Integrate the Google Cloud API with the Data Stores API

Setup the Google Cloud API trigger to run a workflow which integrates with the Data Stores API. Pipedream's integration platform allows you to integrate Google Cloud and Data Stores remarkably fast. Free for developers.

Delete a single record with Data Stores API on BigQuery - Query Results from Google Cloud API
Google Cloud + Data Stores
 
Try it
Add or update a single record with Data Stores API on New Pub/Sub Messages from Google Cloud API
Google Cloud + Data Stores
 
Try it
Add or update multiple records with Data Stores API on New Pub/Sub Messages from Google Cloud API
Google Cloud + Data Stores
 
Try it
Append to record with Data Stores API on New Pub/Sub Messages from Google Cloud API
Google Cloud + Data Stores
 
Try it
Delete a single record with Data Stores API on New Pub/Sub Messages from Google Cloud API
Google Cloud + Data Stores
 
Try it
New Pub/Sub Messages from the Google Cloud API

Emit new Pub/Sub topic in your GCP account. Messages published to this topic are emitted from the Pipedream source.

 
Try it
BigQuery - New Row from the Google Cloud API

Emit new events when a new row is added to a table

 
Try it
BigQuery - Query Results from the Google Cloud API

Emit new events with the results of an arbitrary query

 
Try it
Add or update a single record with the Data Stores API

Add or update a single record in your Pipedream Data Store.

 
Try it
Add or update multiple records with the Data Stores API

Add or update multiple records to your Pipedream Data Store.

 
Try it
Append to record with the Data Stores API

Append to a record in your data store Pipedream Data Store. If the record does not exist, a new record will be created in an array format.

 
Try it
Bigquery Insert Rows with the Google Cloud API

Inserts rows into a BigQuery table. See the docs and for an example here.

 
Try it
Check for existence of key with the Data Stores API

Check if a key exists in your Pipedream Data Store or create one if it doesn't exist.

 
Try it

Overview of Google Cloud

The Google Cloud API opens a world of possibilities for enhancing cloud operations and automating tasks. It empowers you to manage, scale, and fine-tune various services within the Google Cloud Platform (GCP) programmatically. With Pipedream, you can harness this power to create intricate workflows, trigger cloud functions based on events from other apps, manage resources, and analyze data, all in a serverless environment. The ability to interconnect GCP services with numerous other apps enriches automation, making it easier to synchronize data, streamline development workflows, and deploy applications efficiently.

Connect Google Cloud

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
module.exports = defineComponent({
  props: {
    google_cloud: {
      type: "app",
      app: "google_cloud",
    }
  },
  async run({steps, $}) {
    // Required workaround to get the @google-cloud/storage package
    // working correctly on Pipedream
    require("@dylburger/umask")()
    
    const { Storage } = require('@google-cloud/storage')
    
    const key = JSON.parse(this.google_cloud.$auth.key_json)
     
    // Creates a client from a Google service account key.
    // See https://cloud.google.com/nodejs/docs/reference/storage/1.6.x/global#ClientConfig
    const storage = new Storage({
      projectId: key.project_id,
      credentials: {
        client_email: key.client_email,
        private_key: key.private_key,
      }
    })
    
    // Uncomment this section and rename for your bucket before running this code
    // const bucketName = 'pipedream-test-bucket';
    
    await storage.createBucket(bucketName)
    console.log(`Bucket ${bucketName} created.`)
  },
})

Overview of Data Stores

Data Stores are a key-value store that allow you to persist state and share data across workflows. You can perform CRUD operations, enabling dynamic data management within your serverless architecture. Use it to save results from API calls, user inputs, or interim data; then read, update, or enrich this data in subsequent steps or workflows. Data Stores simplify stateful logic and cross-workflow communication, making them ideal for tracking process statuses, aggregating metrics, or serving as a simple configuration store.

Connect Data Stores

1
2
3
4
5
6
7
8
9
10
11
export default defineComponent({
  props: {
    myDataStore: {
      type: "data_store",
    },
  },
  async run({ steps, $ }) {
    await this.myDataStore.set("key_here","Any serializable JSON as the value")
    return await this.myDataStore.get("key_here")
  },
})