Add Voice with ElevenLabs API on New Message Sent from WhatsApp Business API

Pipedream makes it easy to connect APIs for ElevenLabs, WhatsApp Business and 2,900+ other apps remarkably fast.

Trigger workflow on

New Message Sent from the WhatsApp Business API

Next, do this

Add Voice with the ElevenLabs API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a WhatsApp Business trigger and ElevenLabs action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Message Sent trigger
1. Connect your WhatsApp Business account
Configure the Add Voice action
1. Connect your ElevenLabs account
2. Configure Name
3. Configure File Paths or URLs
4. Optional- Configure Description
5. Optional- Configure Labels
6. Optional- Configure syncDir
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Message Sent on WhatsApp Business

Description:Emit new event when a new message is sent or received. A Webhook subscribed to field "messages" must be set up from the App Dashboard of your [Facebook Developer Account](https://developers.facebook.com/). See [documentation](https://developers.facebook.com/docs/graph-api/webhooks/getting-started#configure-webhooks-product) for more information about Webhook setup.

Version:0.0.4

Key:whatsapp_business-new-message-sent

View on GitHub

WhatsApp Business Overview#

The WhatsApp Business API on Pipedream is a powerful avenue for automating interactions with customers on WhatsApp. You can send messages, set up automated responses, and manage conversations on a large scale. With Pipedream's serverless platform, you can create workflows that trigger from various events and connect WhatsApp Business with numerous other apps to automate tasks, notify teams, sync data, and more, all without managing infrastructure.

Trigger Code#

import whatsapp from "../../whatsapp_business.app.mjs";
import sampleEmit from "./test-event.mjs";

export default {
  key: "whatsapp_business-new-message-sent",
  name: "New Message Sent",
  description: "Emit new event when a new message is sent or received. A Webhook subscribed to field \"messages\" must be set up from the App Dashboard of your [Facebook Developer Account](https://developers.facebook.com/). See [documentation](https://developers.facebook.com/docs/graph-api/webhooks/getting-started#configure-webhooks-product) for more information about Webhook setup.",
  version: "0.0.4",
  type: "source",
  dedupe: "unique",
  props: {
    whatsapp,
    db: "$.service.db",
    httpInterface: {
      type: "$.interface.http",
      customResponse: true,
    },
  },
  methods: {
    _getChallengeToken() {
      return this.db.get("challengeToken");
    },
    _setChallengeToken(challengeToken) {
      this.db.set("challengeToken", challengeToken);
    },
  },
  async run(event) {
    const {
      body, query,
    } = event;
    if (query["hub.challenge"]) {
      this._setChallengeToken(query["hub.challenge"]);
    }
    const challengeToken = this._getChallengeToken();

    this.httpInterface.respond({
      status: "200",
      body: challengeToken,
      headers: {
        "content-type": "application/json",
      },
    });

    if (!body) {
      return;
    }

    const entries = body?.entry || [];
    for (const entry of entries) {
      if (entry.changes && entry.changes?.length > 0) {
        const status = entry?.changes[0]?.value?.statuses
          ? entry?.changes[0]?.value?.statuses[0]?.status
          : null;
        if (status && status !== "sent") {
          continue;
        }
      }
      this.$emit(entry, {
        id: Date.now(),
        summary: "New Message Sent",
        ts: Date.now(),
      });
    }
  },
  sampleEmit,
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
WhatsApp Business	`whatsapp`	`app`	This component uses the WhatsApp Business app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
N/A	`httpInterface`	`$.interface.http`	This component uses `$.interface.http` to generate a unique URL when the component is first instantiated. Each request to the URL will trigger the `run()` method of the component.

Trigger Authentication#

WhatsApp Business uses API keys for authentication. When you connect your WhatsApp Business account, Pipedream securely stores the keys so you can easily authenticate to WhatsApp Business APIs in both code and no-code steps.

To connect your WhatsApp Business Cloud account to Pipedream, follow the steps below to find your Business Account ID and your Permanent Access Token.

For additional info on setting up a WhatsApp Business account, refer to their getting started docs

About WhatsApp Business#

WhatsApp Business products support businesses from large to small. Engage audiences, accelerate sales and drive better customer support outcomes on the platform with more than 2 billion users around the world.

Action#

Add Voice on ElevenLabs

Description:Add a voice from one or more audio files. [See the documentation](https://elevenlabs.io/docs/api-reference/add-voice)

Version:0.0.6

Key:elevenlabs-add-voice

View on GitHub

ElevenLabs Overview#

The ElevenLabs API offers text-to-speech capabilities with realistic voice synthesis. Integrating this API on Pipedream allows you to build automated workflows that convert text content into spoken audio files. You can trigger these conversions from various events, process the text data, send it to the ElevenLabs API, and handle the audio output—all within a serverless environment.

Action Code#

import FormData from "form-data";
import elevenlabs from "../../elevenlabs.app.mjs";
import { getFileStreamAndMetadata } from "@pipedream/platform";

export default {
  key: "elevenlabs-add-voice",
  name: "Add Voice",
  version: "0.0.6",
  annotations: {
    destructiveHint: false,
    openWorldHint: true,
    readOnlyHint: false,
  },
  description: "Add a voice from one or more audio files. [See the documentation](https://elevenlabs.io/docs/api-reference/add-voice)",
  type: "action",
  props: {
    elevenlabs,
    name: {
      type: "string",
      label: "Name",
      description: "The name that identifies this voice. This will be displayed in the dropdown of the website.",
    },
    files: {
      type: "string[]",
      label: "File Paths or URLs",
      description: "Provide either an array of file URLs or an array of paths to a files in the /tmp directory (for example, /tmp/myFile.pdf).",
    },
    description: {
      type: "string",
      label: "Description",
      description: "How would you describe the voice?",
      optional: true,
    },
    labels: {
      type: "string",
      label: "Labels",
      description: "Serialized labels dictionary for the voice.",
      optional: true,
    },
    syncDir: {
      type: "dir",
      accessMode: "read",
      sync: true,
      optional: true,
    },
  },
  async run({ $ }) {
    const {
      elevenlabs,
      name,
      files,
      description,
      labels,
    } = this;

    const data = new FormData();
    if (description) data.append("description", description);

    for (const file of files) {
      const {
        stream, metadata,
      } = await getFileStreamAndMetadata(file);
      data.append("files", stream, {
        contentType: metadata.contentType,
        knownLength: metadata.size,
        filename: metadata.name,
      });
    }

    if (labels) data.append("labels", labels);
    data.append("name", name);

    const response = await elevenlabs.addVoice({
      $,
      headers: data.getHeaders(),
      data,
    });

    $.export("$summary", `Successfully added voice (ID: ${response.voice_id})`);
    return response;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
ElevenLabs	`elevenlabs`	`app`	This component uses the ElevenLabs app.
Name	`name`	`string`	The name that identifies this voice. This will be displayed in the dropdown of the website.
File Paths or URLs	`files`	`string[]`	Provide either an array of file URLs or an array of paths to a files in the /tmp directory (for example, /tmp/myFile.pdf).
Description	`description`	`string`	How would you describe the voice?
Labels	`labels`	`string`	Serialized labels dictionary for the voice.
syncDir	`syncDir`	`dir`

Action Authentication#

ElevenLabs uses API keys for authentication. When you connect your ElevenLabs account, Pipedream securely stores the keys so you can easily authenticate to ElevenLabs APIs in both code and no-code steps.

To retrieve your API Key,

Navigate to your ElevenLabs account and sign in
Click the dropdown on the top right
Go to “Profile” > “API Key”

About ElevenLabs#

Research lab exploring new frontiers of Voice AI. Deploying tools for prime long-form synthetic speech, voice cloning and automatic dubbing.