Kafka

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.

Integrate the Kafka API with the OpenAI (ChatGPT) API

Setup the Kafka API trigger to run a workflow which integrates with the OpenAI (ChatGPT) API. Pipedream's integration platform allows you to integrate Kafka and OpenAI (ChatGPT) remarkably fast. Free for developers.

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
New Batch Completed from the OpenAI (ChatGPT) API

Emit new event when a new batch is completed in OpenAI. See the documentation

 
Try it
New File Created from the OpenAI (ChatGPT) API

Emit new event when a new file is created in OpenAI. See the documentation

 
Try it
New Fine Tuning Job Created from the OpenAI (ChatGPT) API

Emit new event when a new fine-tuning job is created in OpenAI. See the documentation

 
Try it
New Run State Changed from the OpenAI (ChatGPT) API

Emit new event every time a run changes its status. See the documentation

 
Try it
Chat with the OpenAI (ChatGPT) API

The Chat API, using the gpt-3.5-turbo or gpt-4 model. See the documentation

 
Try it
Summarize Text with the OpenAI (ChatGPT) API

Summarizes text using the Chat API. See the documentation

 
Try it
Classify Items into Categories with the OpenAI (ChatGPT) API

Classify items into specific categories using the Chat API. See the documentation

 
Try it
Translate Text (Whisper) with the OpenAI (ChatGPT) API

Translate text from one language to another using the Chat API. See the documentation

 
Try it
Create Transcription (Whisper) with the OpenAI (ChatGPT) API

Transcribes audio into the input language. See the documentation.

 
Try it

Connect Kafka

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
import { Kafka } from "kafkajs"
export default defineComponent({
  props: {
    kafka: {
      type: "app",
      app: "kafka",
    }
  },
  async run({steps, $}) {

    const kafka = new Kafka({
      brokers: [`${this.kafka.$auth.host}:${this.kafka.$auth.port}`],
    });

    const consumer = kafka.consumer({ groupId: 'TestGroup' });
    await consumer.connect()
    await consumer.subscribe({ topic: 'SampleTopic', fromBeginning: true });
    let consumedMessage = "";
    const eachMessage = async function({ topic, partition, message }){
      consumedMessage = message.value.toString();
      return consumedMessage;
    };  

    await consumer.run({
      eachMessage,
    });

    const producer = kafka.producer();  
    await producer.connect()
    await producer.send({
      topic: 'SampleTopic',
      messages: [
        { value: 'Welcome KafkaJS + Pipedream users! '+ new Date().toISOString() },
      ],
    });
    await producer.disconnect();

    const data = await consumer.describeGroup();
    return { consumedMessage, groupDescription: data };
  },
})

Overview of OpenAI (ChatGPT)

OpenAI provides a suite of powerful AI models through its API, enabling developers to integrate advanced natural language processing and generative capabilities into their applications. Here’s an overview of the services offered by OpenAI's API:

Use Python or Node.js code to make fully authenticated API requests with your OpenAI account:

Connect OpenAI (ChatGPT)

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    openai: {
      type: "app",
      app: "openai",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://api.openai.com/v1/models`,
      headers: {
        Authorization: `Bearer ${this.openai.$auth.api_key}`,
      },
    })
  },
})

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo