Create Tileset with Mapbox API on New Batch Completed from OpenAI (ChatGPT) API

Pipedream makes it easy to connect APIs for Mapbox, OpenAI (ChatGPT) and 2,500+ other apps remarkably fast.

Trigger workflow on

New Batch Completed from the OpenAI (ChatGPT) API

Next, do this

Create Tileset with the Mapbox API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a OpenAI (ChatGPT) trigger and Mapbox action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Batch Completed trigger
1. Connect your OpenAI (ChatGPT) account
2. Configure timer
Configure the Create Tileset action
1. Connect your Mapbox account
2. Configure Username
3. Configure Tileset Name
4. Configure File Path
5. Configure Recipe
6. Optional- Configure Description
7. Optional- Configure Private
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Batch Completed on OpenAI (ChatGPT)

Description:Emit new event when a new batch is completed in OpenAI. [See the documentation](https://platform.openai.com/docs/api-reference/batch/list)

Version:0.0.7

Key:openai-new-batch-completed

View on GitHub

OpenAI (ChatGPT) Overview#

OpenAI provides a suite of powerful AI models through its API, enabling developers to integrate advanced natural language processing and generative capabilities into their applications. Here’s an overview of the services offered by OpenAI's API:

Use Python or Node.js code to make fully authenticated API requests with your OpenAI account:

Trigger Code#

import common from "../common/common.mjs";
import sampleEmit from "./test-event.mjs";

export default {
  ...common,
  key: "openai-new-batch-completed",
  name: "New Batch Completed",
  description: "Emit new event when a new batch is completed in OpenAI. [See the documentation](https://platform.openai.com/docs/api-reference/batch/list)",
  version: "0.0.7",
  type: "source",
  dedupe: "unique",
  methods: {
    ...common.methods,
    _getLastCompleted() {
      return this.db.get("lastCompleted") || 0;
    },
    _setLastCompleted(lastCompleted) {
      this.db.set("lastCompleted", lastCompleted);
    },
    getMeta(batch) {
      return {
        id: batch.id,
        summary: `Batch Completed with ID ${batch.id}`,
        ts: batch.completed_at * 1000,
      };
    },
    async getAndProcessItems(max) {
      const lastCompleted = this._getLastCompleted();
      let maxCompleted = lastCompleted;
      const results = this.openai.paginate({
        resourceFn: this.openai.listBatches,
        max,
      });
      const batches = [];
      for await (const batch of results) {
        if (batch.completed_at && batch.completed_at > lastCompleted) {
          batches.push(batch);
          maxCompleted = Math.max(batch.completed_at, maxCompleted);
        }
      }
      this._setLastCompleted(maxCompleted);
      batches.reverse().forEach((item) => this.$emit(item, this.getMeta(item)));
    },
  },
  sampleEmit,
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
OpenAI (ChatGPT)	`openai`	`app`	This component uses the OpenAI (ChatGPT) app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
	`timer`	`$.interface.timer`

Trigger Authentication#

OpenAI (ChatGPT) uses API keys for authentication. When you connect your OpenAI (ChatGPT) account, Pipedream securely stores the keys so you can easily authenticate to OpenAI (ChatGPT) APIs in both code and no-code steps.

About OpenAI (ChatGPT)#

OpenAI is an AI research and deployment company with the mission to ensure that artificial general intelligence benefits all of humanity. They are the makers of popular models like ChatGPT, DALL-E, and Whisper.

Action#

Create Tileset on Mapbox

Description:Uploads and creates a new tileset from a data source. [See the documentation](https://docs.mapbox.com/api/maps/mapbox-tiling-service/)

Version:0.0.1

Key:mapbox-create-tileset

View on GitHub

Mapbox Overview#

The Mapbox API offers a suite of tools for developers to integrate location-based services into their applications. With Pipedream, you can leverage Mapbox's capabilities to create complex automations and workflows, like real-time mapping, geocoding, and route optimization. Whether you're managing delivery routes, analyzing spatial data, or personalizing user experiences based on location, Mapbox provides the geographical intelligence that, when combined with Pipedream's serverless platform, can turn these ideas into efficient, automated processes.

Action Code#

import mapbox from "../../mapbox.app.mjs";
import fs from "fs";
import FormData from "form-data";

export default {
  key: "mapbox-create-tileset",
  name: "Create Tileset",
  description: "Uploads and creates a new tileset from a data source. [See the documentation](https://docs.mapbox.com/api/maps/mapbox-tiling-service/)",
  version: "0.0.1",
  type: "action",
  props: {
    mapbox,
    username: {
      type: "string",
      label: "Username",
      description: "The Mapbox username of the account for which to create a tileset source",
    },
    tilesetName: {
      type: "string",
      label: "Tileset Name",
      description: "A unique name for the tileset source to be created. Limited to 32 characters. The only allowed special characters are `-` (hyphen) and `_` (underscore)",
    },
    filePath: {
      type: "string",
      label: "File Path",
      description: "The path to a tileset source file in the `/tmp` directory. [See the documentation on working with files](https://pipedream.com/docs/code/nodejs/working-with-files/#writing-a-file-to-tmp)",
    },
    recipe: {
      type: "object",
      label: "Recipe",
      description: "A recipe that describes how the GeoJSON data you uploaded should be transformed into tiles. A tileset source is raw geographic data formatted as [line-delimited GeoJSON](https://en.wikipedia.org/wiki/JSON_streaming#Line-delimited_JSON), or a supported [raster file format](https://docs.mapbox.com/mapbox-tiling-service/raster/supported-file-formats/). For more information on how to create and format recipes, see the [Recipe reference](https://docs.mapbox.com/mapbox-tiling-service/reference/) and [Recipe examples](https://docs.mapbox.com/mapbox-tiling-service/examples/).",
    },
    description: {
      type: "string",
      label: "Description",
      description: "A description of the tileset",
      optional: true,
    },
    private: {
      type: "boolean",
      label: "Private",
      description: "Describes whether the tileset must be used with an access token from your Mapbox account. Default is `true`.",
      optional: true,
    },
  },
  async run({ $ }) {
    const filePath = this.filePath.includes("tmp/")
      ? this.filePath
      : `/tmp/${this.filePath}`;

    // Create Tileset Source
    try {
      const fileData = new FormData();
      const content = fs.createReadStream(filePath);
      fileData.append("file", content);

      await this.mapbox.createTilesetSource({
        $,
        username: this.username,
        id: this.tilesetName,
        data: fileData,
        headers: fileData.getHeaders(),
      });
    } catch (e) {
      throw new Error(`Error uploading file: \`${filePath}\`. Error: ${e}`);
    }

    const recipe = typeof this.recipe === "string"
      ? JSON.parse(this.recipe)
      : this.recipe;

    // Validate Recipe
    const {
      valid, errors,
    } = await this.mapbox.validateRecipe({
      $,
      data: recipe,
    });

    if (!valid) {
      throw new Error(`Error validating recipe: ${errors}`);
    }

    // Create Tileset
    const response = await this.mapbox.createTileset({
      $,
      tilesetId: `${this.username}.${this.tilesetName}`,
      data: {
        recipe,
        name: this.tilesetName,
        description: this.description,
        private: this.private,
      },
    });

    $.export("$summary", `Created tileset ${this.tilesetName}`);
    return response;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
Mapbox	`mapbox`	`app`	This component uses the Mapbox app.
Username	`username`	`string`	The Mapbox username of the account for which to create a tileset source
Tileset Name	`tilesetName`	`string`	A unique name for the tileset source to be created. Limited to 32 characters. The only allowed special characters are `-` (hyphen) and `_` (underscore)
File Path	`filePath`	`string`	The path to a tileset source file in the `/tmp` directory. See the documentation on working with files
Recipe	`recipe`	`object`	A recipe that describes how the GeoJSON data you uploaded should be transformed into tiles. A tileset source is raw geographic data formatted as line-delimited GeoJSON, or a supported raster file format. For more information on how to create and format recipes, see the Recipe reference and Recipe examples.
Description	`description`	`string`	A description of the tileset
Private	`private`	`boolean`	Describes whether the tileset must be used with an access token from your Mapbox account. Default is `true`.