The platform to set data in motion.
Write custom Node.js code and use any of the 400k+ npm packages available. Refer to the Pipedream Node docs to learn more.
The Confluent API provides programmatic interaction with Confluent Cloud, a fully managed Kafka service. It lets you manage Kafka clusters, topics, users, and configurations, enabling seamless integration and data streaming capabilities. With Pipedream, you can create workflows that automate interactions with your Kafka infrastructure, such as triggering events on message arrival, managing topics, or integrating Kafka data with other services.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
confluent: {
type: "app",
app: "confluent",
}
},
async run({steps, $}) {
const data = {
"topic_name": `pipedream-test`,
}
return await axios($, {
method: "post",
url: `https://${this.confluent.$auth.rest_endpoint_url}/kafka/v3/clusters/${this.confluent.$auth.cluster_id}/topics`,
headers: {
"Content-Type": `application/json`,
},
auth: {
username: `${this.confluent.$auth.api_key}`,
password: `${this.confluent.$auth.api_secret}`,
},
data,
})
},
})
Develop, run and deploy your Node.js code in Pipedream workflows, using it between no-code steps, with connected accounts, or integrate Data Stores and File Stores.
This includes installing NPM packages, within your code without having to manage a package.json
file or running npm install
.
Below is an example of installing the axios
package in a Pipedream Node.js code step. Pipedream imports the axios
package, performs the API request, and shares the response with subsequent workflow steps:
// To use previous step data, pass the `steps` object to the run() function
export default defineComponent({
async run({ steps, $ }) {
// Return data to use it in future steps
return steps.trigger.event
},
})