Search with FireCrawl API on New Render Completed from MoDeck API

Pipedream makes it easy to connect APIs for FireCrawl, MoDeck and 2,700+ other apps remarkably fast.

Trigger workflow on

New Render Completed from the MoDeck API

Next, do this

Search with the FireCrawl API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a MoDeck trigger and FireCrawl action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Render Completed trigger
1. Connect your MoDeck account
2. Configure Polling interval
3. Select a Deck Name
Configure the Search action
1. Connect your FireCrawl account
2. Configure Query
3. Optional- Select one or more Scrape Option Formats
4. Optional- Select a Time Based Search
5. Optional- Configure Custom Timeout
6. Optional- Configure Max Results
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Render Completed on MoDeck

Description:Emit new event when a render is completed.

Version:0.0.1

Key:modeck-render-complete

View on GitHub

MoDeck Overview#

The MoDeck API offers an interface for managing playlists and videos within their platform, providing endpoints for various operations like retrieving video details, updating playlists, or managing users. Integrating MoDeck with Pipedream allows you to automate interactions with your MoDeck data, such as syncing playlists, updating video statuses, or triggering actions based on video analytics. With Pipedream's serverless platform, you can build powerful workflows that react to events in real-time, schedule tasks, and connect MoDeck with hundreds of other services.

Trigger Code#

import { DEFAULT_POLLING_SOURCE_TIMER_INTERVAL } from "@pipedream/platform";
import modeck from "../../modeck.app.mjs";
import sampleEmit from "./test-event.mjs";

export default {
  key: "modeck-render-complete",
  name: "New Render Completed",
  version: "0.0.1",
  description: "Emit new event when a render is completed.",
  type: "source",
  dedupe: "unique",
  props: {
    modeck,
    db: "$.service.db",
    timer: {
      label: "Polling interval",
      description: "Pipedream will poll the MoDeck on this schedule",
      type: "$.interface.timer",
      default: {
        intervalSeconds: DEFAULT_POLLING_SOURCE_TIMER_INTERVAL,
      },
    },
    deck: {
      propDefinition: [
        modeck,
        "deck",
      ],
    },
  },
  methods: {
    _getLastDate() {
      return this.db.get("lastDate") || 0;
    },
    _setLastDate(lastDate) {
      this.db.set("lastDate", lastDate);
    },
    async startEvent(maxResults = 0) {
      const {
        modeck,
        deck,
      } = this;

      const lastDate = this._getLastDate();

      const { renderList } = await modeck.listRenders({
        data: {
          deck,
        },
      });

      let responseArray = [];
      let count = 0;

      for (const render of renderList) {
        if (new Date(render.data) <= new Date(lastDate)) break;
        responseArray.push(render);
        if (maxResults && (++count === maxResults)) break;
      }
      if (responseArray.length) this._setLastDate(responseArray[0].date);

      for (const render of responseArray.reverse()) {
        this.$emit(
          render,
          {
            id: render.id,
            summary: `The render with id: "${render.id}" has been completed!`,
            ts: render.date,
          },
        );
      }
    },
  },
  hooks: {
    async deploy() {
      await this.startEvent(25);
    },
  },
  async run() {
    await this.startEvent();
  },
  sampleEmit,
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
MoDeck	`modeck`	`app`	This component uses the MoDeck app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
Polling interval	`timer`	`$.interface.timer`	Pipedream will poll the MoDeck on this schedule
Deck Name	`deck`	`string`	Select a value from the drop down menu.

Trigger Authentication#

MoDeck uses API keys for authentication. When you connect your MoDeck account, Pipedream securely stores the keys so you can easily authenticate to MoDeck APIs in both code and no-code steps.

About MoDeck#

Create video templates in After Effects, make them editable online by anyone. You control the creative, let your team control the content.

Action#

Search on FireCrawl

Description:Search the web and get full content from results. [See the documentation](https://docs.firecrawl.dev/features/search)

Version:0.0.1

Key:firecrawl-search

View on GitHub

Action Code#

import firecrawl from "../../firecrawl.app.mjs";

export default {
  key: "firecrawl-search",
  name: "Search",
  description: "Search the web and get full content from results. [See the documentation](https://docs.firecrawl.dev/features/search)",
  version: "0.0.1",
  type: "action",
  props: {
    firecrawl,
    query: {
      type: "string",
      label: "Query",
      description: "The query to search for",
    },
    scrapeOptionFormats: {
      type: "string[]",
      label: "Scrape Option Formats",
      description: "Search with content scraping. You can specify multiple output formats.",
      options: [
        {
          label: "Clean, formatted markdown content",
          value: "markdown",
        },
        {
          label: "Processed HTML content",
          value: "html",
        },
        {
          label: "Unmodified HTML content",
          value: "rawHtml",
        },
        {
          label: "List of links found on the page",
          value: "links",
        },
        {
          label: "Screenshot of the page",
          value: "screenshot",
        },
        {
          label: "Full-page screenshot",
          value: "screenshot@fullPage",
        },
        {
          label: "Structured data extraction",
          value: "extract",
        },
      ],
      optional: true,
    },
    timeBasedSearch: {
      type: "string",
      label: "Time Based Search",
      description: "Filter the results by time",
      options: [
        {
          label: "Past hour",
          value: "qdr:h",
        },
        {
          label: "Past 24 hours",
          value: "qdr:d",
        },
        {
          label: "Past week",
          value: "qdr:w",
        },
        {
          label: "Past month",
          value: "qdr:m",
        },
        {
          label: "Past year",
          value: "qdr:y",
        },
      ],
      optional: true,
    },
    customTimeout: {
      type: "integer",
      label: "Custom Timeout",
      description: "Set a custom timeout for search operations. E.g. `30000`",
      optional: true,
    },
    maxResults: {
      type: "integer",
      label: "Max Results",
      description: "The maximum number of results to return",
      default: 10,
      optional: true,
    },
  },
  async run({ $ }) {
    const results = await this.firecrawl.search({
      $,
      data: {
        query: this.query,
        limit: this.maxResults,
        scrapeOptions: this.scrapeOptionFormats
          ? {
            formats: this.scrapeOptionFormats,
          }
          : undefined,
        tbs: this.timeBasedSearch,
        timeout: this.customTimeout,
      },
    });
    $.export("$summary", `Successfully searched for ${this.query}`);
    return results;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
FireCrawl	`firecrawl`	`app`	This component uses the FireCrawl app.
Query	`query`	`string`	The query to search for
Scrape Option Formats	`scrapeOptionFormats`	`string[]`	Select a value from the drop down menu:`{ "label": "Clean, formatted markdown content", "value": "markdown" }{ "label": "Processed HTML content", "value": "html" }{ "label": "Unmodified HTML content", "value": "rawHtml" }{ "label": "List of links found on the page", "value": "links" }{ "label": "Screenshot of the page", "value": "screenshot" }{ "label": "Full-page screenshot", "value": "screenshot@fullPage" }{ "label": "Structured data extraction", "value": "extract" }`
Time Based Search	`timeBasedSearch`	`string`	Select a value from the drop down menu:`{ "label": "Past hour", "value": "qdr:h" }{ "label": "Past 24 hours", "value": "qdr:d" }{ "label": "Past week", "value": "qdr:w" }{ "label": "Past month", "value": "qdr:m" }{ "label": "Past year", "value": "qdr:y" }`
Custom Timeout	`customTimeout`	`integer`	Set a custom timeout for search operations. E.g. `30000`
Max Results	`maxResults`	`integer`	The maximum number of results to return