Compare Arrays with Helper Functions API on New or Removed Documents in a Collection from Fauna API

Pipedream makes it easy to connect APIs for Helper Functions, Fauna and 2,400+ other apps remarkably fast.

Trigger workflow on

New or Removed Documents in a Collection from the Fauna API

Next, do this

Compare Arrays with the Helper Functions API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a Fauna trigger and Helper Functions action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New or Removed Documents in a Collection trigger
1. Configure timer
2. Connect your Fauna account
3. Select a Collection
4. Optional- Configure Emit changes as a single event
Configure the Compare Arrays action
1. Connect your Helper Functions account
2. Configure Array 1
3. Configure Array 2
4. Select a Compare Action
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New or Removed Documents in a Collection on Fauna

Description:Emit new event each time you add or remove a document from a specific collection, with the details of the document.

Version:0.0.8

Key:faunadb-changes-to-collection

View on GitHub

Fauna Overview#

Fauna API offers a powerful serverless database solution for modern applications. Its unique capabilities allow for highly scalable, secure, and flexible data management. With Pipedream, you can harness the power of Fauna to create intricate serverless workflows that react to various triggers, manage data efficiently, and connect seamlessly with other services and APIs to automate complex tasks.

Trigger Code#

import fauna from "../../faunadb.app.mjs";
import _ from "lodash";
import { DEFAULT_POLLING_SOURCE_TIMER_INTERVAL } from "@pipedream/platform";

export default {
  type: "source",
  key: "faunadb-changes-to-collection",
  name: "New or Removed Documents in a Collection",
  description: "Emit new event each time you add or remove a document from a specific collection, with the details of the document.",
  version: "0.0.8",
  dedupe: "unique", // Dedupe events based on the concatenation of event + document ref id
  props: {
    timer: {
      type: "$.interface.timer",
      default: {
        intervalSeconds: DEFAULT_POLLING_SOURCE_TIMER_INTERVAL,
      },
    },
    db: "$.service.db",
    fauna,
    collection: {
      propDefinition: [
        fauna,
        "collections",
      ],
    },
    emitEventsInBatch: {
      type: "boolean",
      label: "Emit changes as a single event",
      description:
        "If `true`, all events are emitted as an array, within a single Pipedream event. Defaults to `false`, emitting each event in Fauna as its own event in Pipedream",
      optional: true,
      default: false,
    },
  },
  async run() {
    // As soon as the script runs, mark the start time so we can fetch changes
    // since this time on the next run. Fauna expects epoch ms as its cursor.
    const ts = +new Date() * 1000;
    const cursor = this.db.get("cursor") || ts;

    const events = await this.fauna.getEventsInCollectionAfterTs(
      this.collection,
      cursor,
    );

    if (!events.length) {
      console.log(`No new events in collection ${this.collection}`);
      this.db.set("cursor", ts);
      return;
    }

    console.log(`${events.length} new events in collection ${this.collection}`);

    // Batched emits do not take advantage of the built-in deduper
    if (this.emitEventsInBatch) {
      this.$emit({
        events,
      }, {
        summary: `${events.length} new event${events.length > 1
          ? "s"
          : ""}`,
        id: cursor,
      });
    } else {
      for (const event of events) {
        this.$emit(event, {
          summary: `${event.action.toUpperCase()} - ${event.document.id}`,
          id: `${event.action}-${event.document.id}`, // dedupes events based on this ID
        });
      }
    }

    // Finally, set cursor for the next run to the max timestamp of the changed events, ensuring we
    // get all events after that on the next run. We need to add 1 since the timestamp filter in
    // Fauna is inclusive: https://docs.fauna.com/fauna/current/api/fql/functions/paginate
    const maxEventTs = _.maxBy(events, (event) => event.ts).ts + 1;

    this.db.set("cursor", maxEventTs);
  },
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
	`timer`	`$.interface.timer`
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
Fauna	`fauna`	`app`	This component uses the Fauna app.
Collection	`collection`	`string`	Select a value from the drop down menu.
Emit changes as a single event	`emitEventsInBatch`	`boolean`	If `true`, all events are emitted as an array, within a single Pipedream event. Defaults to `false`, emitting each event in Fauna as its own event in Pipedream

Trigger Authentication#

Fauna uses API keys for authentication. When you connect your Fauna account, Pipedream securely stores the keys so you can easily authenticate to Fauna APIs in both code and no-code steps.

Create a key in the Security section of your FaunaDB dashboard, then enter the Secret below.

About Fauna#

The distributed serverless database combining the flexibility of NoSQL with the relational querying capabilities of SQL systems.

Action#

Compare Arrays on Helper Functions

Description:Get the difference, intersection, union, or symetric difference of two arrays/sets.

Version:0.0.1

Key:helper_functions-compare-arrays

View on GitHub

Helper Functions Overview#

The Helper Functions app on Pipedream is a set of pre-built functions that streamline common tasks in your workflows. It acts like a Swiss Army knife for developers, providing essential tools such as format conversion, date manipulation, and text processing. By leveraging these functions, you can reduce the boilerplate code needed for routine operations, speeding up the development of intricate automations. The Helper Functions API can be a game changer when it comes to tasks like parsing dates in user-friendly formats, encoding and decoding data, or generating UUIDs, making them more efficient and less error-prone.

Action Code#

import helperFunctions from "../../helper_functions.app.mjs";

export default {
  key: "helper_functions-compare-arrays",
  name: "Compare Arrays",
  description: "Get the difference, intersection, union, or symetric difference of two arrays/sets.",
  version: "0.0.1",
  type: "action",
  props: {
    helperFunctions,
    array1: {
      type: "string[]",
      label: "Array 1",
      description: "Array to compare to second array",
      default: [],
    },
    array2: {
      type: "string[]",
      label: "Array 2",
      description: "Array to be compared with first array",
      default: [],
    },
    actionType: {
      type: "string",
      label: "Compare Action",
      description: "Type of action to perform on the arrays",
      options: [
        "difference",
        "union",
        "intersection",
        "symmetric difference",
      ],
    },
  },
  methods: {
    getDifference(set1, set2) {
      return new Set([
        ...set1,
      ].filter((x) => !set2.has(x)));
    },
    getIntersection(set1, set2) {
      return new Set([
        ...set1,
      ].filter((x) => set2.has(x)));
    },
    getUnion(set1, set2) {
      for (const elem of set2) {
        set1.add(elem);
      }
      return set1;
    },
    getSymmetricDifference(set1, set2) {
      for (const elem of set2) {
        if (set1.has(elem)) {
          set1.delete(elem);
        } else {
          set1.add(elem);
        }
      }
      return set1;
    },
  },
  run() {
    const set1 = new Set(this.array1);
    const set2 = new Set(this.array2);

    let results;

    switch (this.actionType) {
    case "difference": {
      results = this.getDifference(set1, set2);
      break;
    }
    case "union": {
      results = this.getUnion(set1, set2);
      break;
    }
    case "intersection": {
      results = this.getIntersection(set1, set2);
      break;
    }
    case "symmetric difference": {
      results = this.getSymmetricDifference(set1, set2);
      break;
    }
    default:
      throw new Error(`Unknown action type: ${this.actionType}`);
    }

    return Array.from(results);
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
Helper Functions	`helperFunctions`	`app`	This component uses the Helper Functions app.
Array 1	`array1`	`string[]`	Array to compare to second array
Array 2	`array2`	`string[]`	Array to be compared with first array
Compare Action	`actionType`	`string`	Select a value from the drop down menu:`differenceunionintersectionsymmetric difference`