with DigitalOcean Spaces and Google Cloud?
Emit new Pub/Sub topic in your GCP account. Messages published to this topic are emitted from the Pipedream source.
Emit new event when a file is deleted from a DigitalOcean Spaces bucket
Emit new events with the results of an arbitrary query
Emit new event when a file is uploaded to a DigitalOcean Spaces bucket
Inserts rows into a BigQuery table. See the docs and for an example here
Accepts a file path starting from /tmp, then uploads as a file to DigitalOcean Spaces. See the docs
DigitalOcean Spaces API permits you to manage object storage, allowing for the storage and serving of massive amounts of data. This API is great for backing up, archiving, and providing public access to data or assets. On Pipedream, you can use this API to automate file operations like uploads, downloads, and deletions, as well as manage permissions and metadata. You can integrate it with other services for end-to-end workflow automation.
import { S3 } from "@aws-sdk/client-s3";
import { ListBucketsCommand } from "@aws-sdk/client-s3";
export default defineComponent({
props: {
digitalocean_spaces: {
type: "app",
app: "digitalocean_spaces"
}
},
async run({ steps, $ }) {
console.log(this.digitalocean_spaces.$auth)
const s3Client = new S3({
forcePathStyle: false, // Configures to use subdomain/virtual calling format.
endpoint: `https://${this.digitalocean_spaces.$auth.region}.digitaloceanspaces.com`,
region: "us-east-1",
credentials: {
accessKeyId: this.digitalocean_spaces.$auth.key,
secretAccessKey: this.digitalocean_spaces.$auth.secret
}
});
const data = await s3Client.send(new ListBucketsCommand({}));
return data.Buckets;
},
})
The Google Cloud API opens a world of possibilities for enhancing cloud operations and automating tasks. It empowers you to manage, scale, and fine-tune various services within the Google Cloud Platform (GCP) programmatically. With Pipedream, you can harness this power to create intricate workflows, trigger cloud functions based on events from other apps, manage resources, and analyze data, all in a serverless environment. The ability to interconnect GCP services with numerous other apps enriches automation, making it easier to synchronize data, streamline development workflows, and deploy applications efficiently.
module.exports = defineComponent({
props: {
google_cloud: {
type: "app",
app: "google_cloud",
}
},
async run({steps, $}) {
// Required workaround to get the @google-cloud/storage package
// working correctly on Pipedream
require("@dylburger/umask")()
const { Storage } = require('@google-cloud/storage')
const key = JSON.parse(this.google_cloud.$auth.key_json)
const storage = new Storage({
projectId: key.project_id,
credentials: {
client_email: key.client_email,
private_key: key.private_key,
}
})
await storage.authClient.getCredentials()
return {
status: "success",
authenticated: true,
projectId: key.project_id,
serviceAccount: key.client_email
}
},
})