← AWS + Airtable integrations

Create Multiple Records with Airtable API on New Restored S3 File from AWS API

Pipedream makes it easy to connect APIs for Airtable, AWS and 900+ other apps remarkably fast.

Trigger workflow on
New Restored S3 File from the AWS API
Next, do this
Create Multiple Records with the Airtable API
No credit card required
Into to Pipedream
Watch us build a workflow
Watch us build a workflow
7 min
Watch now ➜
Trusted by 250,000+ developers from startups to Fortune 500 companies:
Trusted by 250,000+ developers from startups to Fortune 500 companies

Developers Pipedream

Getting Started

This integration creates a workflow with a AWS trigger and Airtable action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

  1. Select this integration
  2. Configure the New Restored S3 File trigger
    1. Connect your AWS account
    2. Select a AWS Region
    3. Select a S3 Bucket Name
    4. Configure Detect Restore Initiation
  3. Configure the Create Multiple Records action
    1. Connect your Airtable account
    2. Select a Base
    3. Select a Table
    4. Configure Records
    5. Configure Typecast
  4. Deploy the workflow
  5. Send a test event to validate your setup
  6. Turn on the trigger

Details

This integration uses pre-built, open source components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger

Description:Emit new event when an file is restored into a S3 bucket
Version:0.0.1
Key:aws-s3-restored-file

AWS Overview

You can use the AWS API to build a variety of applications and services. Here
are some examples:

  • A mobile application that allows users to access data stored in the cloud
  • A web application that allows users to upload and download files
  • A web service that allows developers to access Amazon's vast product catalog
  • A desktop application that allows users to access their Amazon account
    information

Trigger Code

import base from "../common/s3.mjs";

export default {
  ...base,
  type: "source",
  key: "aws-s3-restored-file",
  name: "New Restored S3 File",
  description: "Emit new event when an file is restored into a S3 bucket",
  version: "0.0.1",
  dedupe: "unique",
  props: {
    ...base.props,
    detectRestoreInitiation: {
      type: "boolean",
      label: "Detect Restore Initiation",
      description: "When enabled, this event source will also emit events whenever a restore is initiated",
      default: false,
    },
  },
  methods: {
    ...base.methods,
    getEvents() {
      return [
        this.detectRestoreInitiation
          ? "s3:ObjectRestore:*"
          : "s3:ObjectRestore:Completed",
      ];
    },
    generateMeta(data) {
      const { "x-amz-request-id": id } = data.responseElements;
      const { key } = data.s3.object;
      const { eventTime: isoTimestamp } = data;
      return {
        id,
        summary: `Restored file: '${key}'`,
        ts: Date.parse(isoTimestamp),
      };
    },
  },
};

Trigger Configuration

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.
LabelPropTypeDescription
AWSawsappThis component uses the AWS app.
N/Adb$.service.dbThis component uses $.service.db to maintain state between component invocations.
N/Ahttp$.interface.httpThis component uses $.interface.http to generate a unique URL when the component is first instantiated. Each request to the URL will trigger the run() method of the component.
AWS RegionregionstringSelect a value from the drop down menu.
S3 Bucket NamebucketstringSelect a value from the drop down menu.
Detect Restore InitiationdetectRestoreInitiationboolean

When enabled, this event source will also emit events whenever a restore is initiated

Trigger Authentication

AWS uses API keys for authentication. When you connect your AWS account, Pipedream securely stores the keys so you can easily authenticate to AWS APIs in both code and no-code steps.

Follow the AWS Instructions for creating an IAM user with an associated access and secret key.

As a best practice, attach the minimum set of IAM permissions necessary to perform the specific task in Pipedream. If your workflow only needs to perform a single API call, you should create a user and associate an IAM group / policy with permission to do only that task. You can create as many linked AWS accounts in Pipedream as you'd like.

Enter your access and secret key below.

About AWS

On-demand cloud computing platforms and APIs

Action

Description:Create one or more records in a table by passing an array of objects containing field names and values as key/value pairs.
Version:0.2.0
Key:airtable-create-multiple-records

Airtable Overview

Using the Airtable API, you can build applications that can:

  • Create and manage databases
  • Add, update, and delete records
  • Search for records
  • Sort and filter records
  • Display records in a variety of ways
  • Import and export data

Action Code

import chunk from "lodash.chunk";
import airtable from "../../airtable.app.mjs";
import common from "../common.mjs";

const BATCH_SIZE = 10; // The Airtable API allows us to update up to 10 rows per request.

export default {
  key: "airtable-create-multiple-records",
  name: "Create Multiple Records",
  description: "Create one or more records in a table by passing an array of objects containing field names and values as key/value pairs.",
  version: "0.2.0",
  type: "action",
  props: {
    ...common.props,
    records: {
      propDefinition: [
        airtable,
        "records",
      ],
    },
    typecast: {
      propDefinition: [
        airtable,
        "typecast",
      ],
    },
  },
  async run({ $ }) {
    const baseId = this.baseId?.value ?? this.baseId;
    const tableId = this.tableId?.value ?? this.tableId;

    const table = this.airtable.base(baseId)(tableId);

    let data = this.records;
    if (!Array.isArray(data)) {
      data = JSON.parse(data);
    }
    data = data.map((fields) => ({
      fields,
    }));
    if (!data.length) {
      throw new Error("No Airtable record data passed to step. Please pass at least one record");
    }

    const params = {
      typecast: this.typecast,
    };

    const responses = [];
    for (const c of chunk(data, BATCH_SIZE)) {
      try {
        responses.push(...(await table.create(c, params)));
      } catch (err) {
        this.airtable.throwFormattedError(err);
      }
    }

    const l = responses.length;
    $.export("$summary", `Added ${l} record${l === 1
      ? ""
      : "s"} to ${this.baseId?.label || baseId}: [${this.tableId?.label || tableId}](https://airtable.com/${baseId}/${tableId})`);

    return responses;
  },
};

Action Configuration

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

LabelPropTypeDescription
AirtableairtableappThis component uses the Airtable app.
BasebaseIdstringSelect a value from the drop down menu.
TabletableIdstringSelect a value from the drop down menu.
Recordsrecordsstring

Provide an array of objects. Each object should represent a new record with the column name as the key and the data to insert as the corresponding value (e.g., passing [{"foo":"bar","id":123},{"foo":"baz","id":456}] will create two records and with values added to the fields foo and id). The most common pattern is to reference an array of objects exported by a previous step (e.g., {{steps.foo.$return_value}}). You may also enter or construct a string that will JSON.parse() to an array of objects.

Typecasttypecastboolean

The Airtable API will perform best-effort automatic data conversion from string values if the typecast parameter is True. Automatic conversion is disabled by default to ensure data integrity, but it may be helpful for integrating with 3rd party data sources.

Action Authentication

Airtable uses API keys for authentication. When you connect your Airtable account, Pipedream securely stores the keys so you can easily authenticate to Airtable APIs in both code and no-code steps.

Visit your account settings, copy your API key, and enter it below. If you only need to read data from Airtable, and not modify it, you can generate a read-only API key.


get airtable api key

About Airtable

Looks like a spreadsheet, acts like a database.

More Ways to Connect Airtable + AWS

Create single record with Airtable API on New Deleted S3 File from AWS API
AWS + Airtable
 
Try it
Create single record with Airtable API on New Inbound SES Emails from AWS API
AWS + Airtable
 
Try it
Create single record with Airtable API on New Records Returned by CloudWatch Logs Insights Query from AWS API
AWS + Airtable
 
Try it
Create single record with Airtable API on New Restored S3 File from AWS API
AWS + Airtable
 
Try it
Create single record with Airtable API on New S3 Event from AWS API
AWS + Airtable
 
Try it
New Scheduled Tasks from the AWS API

Creates a Step Function State Machine to publish a message to an SNS topic at a specific timestamp. The SNS topic delivers the message to this Pipedream source, and the source emits it as a new event.

 
Try it
New SNS Messages from the AWS API

Creates an SNS topic in your AWS account. Messages published to this topic are emitted from the Pipedream source.

 
Try it
New Inbound SES Emails from the AWS API

The source subscribes to all emails delivered to a specific domain configured in AWS SES. When an email is sent to any address at the domain, this event source emits that email as a formatted event. These events can trigger a Pipedream workflow and can be consumed via SSE or REST API.

 
Try it
New Deleted S3 File from the AWS API

Emit new event when a file is deleted from a S3 bucket

 
Try it
New Records Returned by CloudWatch Logs Insights Query from the AWS API

Executes a CloudWatch Logs Insights query on a schedule, and emits the records as invidual events (default) or in batch

 
Try it
CloudWatch Logs - Put Log Event with the AWS API

Uploads a log event to the specified log stream. See docs

 
Try it
DynamoDB - Create Table with the AWS API

Creates a new table to your account. See docs

 
Try it
DynamoDB - Execute Statement with the AWS API

This operation allows you to perform transactional reads or writes on data stored in DynamoDB, using PartiQL. See docs

 
Try it
DynamoDB - Get Item with the AWS API

The Get Item operation returns a set of attributes for the item with the given primary key. If there is no matching item, Get Item does not return any data and there will be no Item element in the response. See docs

 
Try it
DynamoDB - Put Item with the AWS API

Creates a new item, or replaces an old item with a new item. If an item that has the same primary key as the new item already exists in the specified table, the new item completely replaces the existing item. See docs

 
Try it