What do you want to automate
with Kafka and Tinybird?
Prompt, edit and deploy AI agents that connect to Kafka, Tinybird and 2,800+ other apps in seconds.
Trusted by 1,000,000+ developers from startups to Fortune 500 companies
Start for free — no credit card required
Watch a demo
Integrate the Kafka API with the Tinybird API
Setup the Kafka API trigger to run a workflow which integrates with the Tinybird API. Pipedream's integration platform allows you to integrate Kafka and Tinybird remarkably fast. Free for developers.
Connect Kafka#
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
import { Kafka } from "kafkajs"
export default defineComponent({
props: {
kafka: {
type: "app",
app: "kafka",
}
},
async run({steps, $}) {
const kafka = new Kafka({
brokers: [`${this.kafka.$auth.host}:${this.kafka.$auth.port}`],
});
const consumer = kafka.consumer({ groupId: 'TestGroup' });
await consumer.connect()
await consumer.subscribe({ topic: 'SampleTopic', fromBeginning: true });
let consumedMessage = "";
const eachMessage = async function({ topic, partition, message }){
consumedMessage = message.value.toString();
return consumedMessage;
};
await consumer.run({
eachMessage,
});
const producer = kafka.producer();
await producer.connect()
await producer.send({
topic: 'SampleTopic',
messages: [
{ value: 'Welcome KafkaJS + Pipedream users! '+ new Date().toISOString() },
],
});
await producer.disconnect();
const data = await consumer.describeGroup();
return { consumedMessage, groupDescription: data };
},
})
Overview of Tinybird#
Tinybird is a real-time analytics API platform that allows developers to ingest, transform, and consume large amounts of data with low latency. By leveraging SQL and data streaming, Tinybird helps in building data-intensive applications or augmenting existing ones with real-time analytics features. On Pipedream, you can automate data ingestion, transformation, and delivery to unlock insights and drive actions in real time, transforming how you respond to user behavior and operational events.
Connect Tinybird#
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
tinybird: {
type: "app",
app: "tinybird",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.tinybird.co/v0/tokens`,
headers: {
Authorization: `Bearer ${this.tinybird.$auth.token}`,
},
})
},
})
Start for free — no credit card required
Watch a demo
Trusted by 1,000,000+ developers from startups to Fortune 500 companies