with Cloudflare R2 and SFTP (key-based auth)?
Emit new events when files get created, changed or deleted from a remote directory. See the docs
Uploads a file or string in UTF-8 format to the SFTP server. See the documentation
The Cloudflare R2 API lets you interact with Cloudflare's object storage service, providing a cost-effective way to store large amounts of data with no egress fees. On Pipedream, you can harness this API to build automated workflows that can store, retrieve, and manage data within your R2 buckets. By combining Cloudflare R2 with Pipedream’s capabilities, you can create serverless workflows that trigger on various events, process data in-flight, and integrate with over 800+ apps available on the platform.
import { S3 } from "@aws-sdk/client-s3";
import { ListBucketsCommand } from "@aws-sdk/client-s3";
export default defineComponent({
props: {
cloudflare_r2: {
type: "app",
app: "cloudflare_r2",
}
},
async run({ steps, $ }) {
const cloudflare_r2 = {
account_id: this.cloudflare_r2.$auth.account_id
};
const s3Client = new S3({
forcePathStyle: false,
endpoint: `https://${cloudflare_r2.account_id}.r2.cloudflarestorage.com`,
region: "auto",
credentials: {
accessKeyId: this.cloudflare_r2.$auth.access_key_id,
secretAccessKey: this.cloudflare_r2.$auth.access_key_secret
}
});
const data = await s3Client.send(new ListBucketsCommand({}));
return data.Buckets;
}
}
)
The SFTP (key-based auth) app on Pipedream allows you to securely transfer and manage files over a network. It uses SSH for data transfer and provides the same level of security as SSH, without requiring password authentication, making automation workflows more secure and less prone to human error. You can automate file uploads, downloads, synchronization tasks, and efficiently manage your remote files in a serverless environment. Integrating this with other Pipedream-supported apps enables you to craft powerful and secure data flow systems.
module.exports = defineComponent({
props: {
sftp: {
type: "app",
app: "sftp",
}
},
async run({steps, $}) {
const Client = require('ssh2-sftp-client');
const {
host,
username,
privateKey,
} = this.sftp.$auth
const config = {
host,
username,
privateKey,
}
const sftp = new Client()
await sftp.connect(config)
this.cwd = await sftp.cwd();
return await sftp.end();
},
})