Export Table (Bulk Download) with Nasdaq Data Link (Time Series and Table data) API on New Download Counts from npm API

Pipedream makes it easy to connect APIs for Nasdaq Data Link (Time Series and Table data), npm and 2,900+ other apps remarkably fast.

Trigger workflow on

New Download Counts from the npm API

Next, do this

Export Table (Bulk Download) with the Nasdaq Data Link (Time Series and Table data) API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a npm trigger and Nasdaq Data Link (Time Series and Table data) action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Download Counts trigger
1. Connect your npm account
2. Configure timer
3. Select a Period
4. Optional- Configure Package
Configure the Export Table (Bulk Download) action
1. Connect your Nasdaq Data Link (Time Series and Table data) account
2. Configure Publisher Code
3. Configure Table Code
4. Optional- Select one or more Columns
5. Optional- Configure Row Filters
6. Optional- Configure Filter Operators
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Download Counts on npm

Description:Emit new event with the latest count of downloads for an npm package. [See the documentation](https://github.com/npm/registry/blob/main/docs/download-counts.md).

Version:0.1.0

Key:npm-download-counts

View on GitHub

Trigger Code#

import app from "../../npm.app.mjs";

export default {
  key: "npm-download-counts",
  name: "New Download Counts",
  description: "Emit new event with the latest count of downloads for an npm package. [See the documentation](https://github.com/npm/registry/blob/main/docs/download-counts.md).",
  version: "0.1.0",
  type: "source",
  props: {
    app,
    db: "$.service.db",
    timer: {
      type: "$.interface.timer",
      description: "One day interval time is recommended because NPM only update metrics once a day. [See the documentation](https://github.com/npm/registry/blob/main/docs/download-counts.md#data-source).",
      default: {
        intervalSeconds: 60 * 60 * 24,
      },
    },
    period: {
      type: "string",
      label: "Period",
      description: "Select last-day, last-week or last-month.",
      optional: false,
      default: "last-day",
      options: [
        "last-day",
        "last-week",
        "last-month",
      ],
    },
    packageName: {
      type: "string",
      label: "Package",
      description: "Enter an npm package name. Leave blank for all",
      optional: true,
    },
  },
  methods: {
    getDownloadCounts({
      period, packageName, ...args
    } = {}) {
      const basePath = `/downloads/point/${encodeURIComponent(period)}`;
      return this.app.makeRequest({
        path: packageName
          ? `${basePath}/${encodeURIComponent(packageName)}`
          : basePath,
        ...args,
      });
    },
  },
  async run({ timestamp: ts }) {
    const {
      getDownloadCounts,
      period,
      packageName,
    } = this;

    const response = await getDownloadCounts({
      period,
      packageName,
    });

    this.$emit(response, {
      id: ts,
      summary: `New Download Count ${response.downloads}`,
      ts,
    });
  },
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
npm	`app`	`app`	This component uses the npm app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
	`timer`	`$.interface.timer`	One day interval time is recommended because NPM only update metrics once a day. See the documentation
Period	`period`	`string`	Select a value from the drop down menu:`last-daylast-weeklast-month`
Package	`packageName`	`string`	Enter an npm package name. Leave blank for all

Trigger Authentication#

The npm API does not require authentication.

About npm#

Node package manager

Action#

Export Table (Bulk Download) on Nasdaq Data Link (Time Series and Table data)

Description:Exports an entire table or a filtered subset as a zipped CSV file. Returns a download link for the data. Premium subscribers can use this feature up to 60 times per hour. [See the documentation](https://docs.data.nasdaq.com/docs/large-table-download)

Version:0.0.2

Key:nasdaq_data_link_time_series_and_table_data_-export-table

View on GitHub

Nasdaq Data Link (Time Series and Table data) Overview#

The Nasdaq Data Link API provides access to financial, economic, and alternative data that powers investment decisions, research, and more. Within Pipedream, you can use this API to automate workflows involving time series and table data. This might include fetching stock prices, economic indicators, or data for quantitative analysis. By creating workflows that trigger on schedules or events, you can efficiently process and act upon this data. Combine it with other apps to gain insights, notify stakeholders, or integrate with your databases.

Action Code#

import app from "../../nasdaq_data_link_time_series_and_table_data_.app.mjs";
import utils from "../../common/utils.mjs";

export default {
  key: "nasdaq_data_link_time_series_and_table_data_-export-table",
  name: "Export Table (Bulk Download)",
  description: "Exports an entire table or a filtered subset as a zipped CSV file. Returns a download link for the data. Premium subscribers can use this feature up to 60 times per hour. [See the documentation](https://docs.data.nasdaq.com/docs/large-table-download)",
  version: "0.0.2",
  annotations: {
    destructiveHint: false,
    openWorldHint: true,
    readOnlyHint: false,
  },
  type: "action",
  props: {
    app,
    publisher: {
      propDefinition: [
        app,
        "publisher",
      ],
    },
    table: {
      propDefinition: [
        app,
        "table",
      ],
    },
    columns: {
      propDefinition: [
        app,
        "columns",
        ({
          publisher, table,
        }) => ({
          publisher,
          table,
        }),
      ],
    },
    filters: {
      type: "object",
      label: "Row Filters",
      description: "Filter rows based on column values. Use column names as keys and values to filter by. For example: `{ \"ticker\": \"SPY\", \"date\": \"2024-01-01\" }`. Only filterable columns can be used (check table metadata).",
      optional: true,
    },
    filterOperators: {
      type: "object",
      label: "Filter Operators",
      description: "Apply operators to filters. Format: `{ \"column.operator\": \"value\" }`. Available operators: `.gt` (greater than), `.lt` (less than), `.gte` (greater than or equal), `.lte` (less than or equal). Example: `{ \"date.gte\": \"2024-01-01\", \"date.lte\": \"2024-12-31\" }`",
      optional: true,
    },
  },
  async run({ $ }) {
    const {
      app,
      publisher,
      table,
      columns,
      filters,
      filterOperators,
    } = this;

    const response = await app.tableData({
      $,
      publisher,
      table,
      params: {
        "qopts.export": true,
        ...utils.parseJson(filters),
        ...utils.parseJson(filterOperators),
        ...(Array.isArray(columns) && columns?.length
          ? {
            "qopts.columns": columns.join(","),
          }
          : undefined
        ),
      },
    });

    const status = response?.datatable_bulk_download?.file?.status;
    const link = response?.datatable_bulk_download?.file?.link;

    if (status === "fresh" && link) {
      $.export("$summary", `Table ${publisher}/${table} is ready for download. The download link is valid for 30 minutes.`);

    } else if (status === "creating" || status === "regenerating") {
      $.export("$summary", `Export job for table ${publisher}/${table} is ${status}. Please retry in a few moments to get the download link.`);

    } else {
      $.export("$summary", `Export initiated for table ${publisher}/${table}`);
    }

    return response;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
Nasdaq Data Link (Time Series and Table data)	`app`	`app`	This component uses the Nasdaq Data Link (Time Series and Table data) app.
Publisher Code	`publisher`	`string`	The publisher code (e.g., `MER`, `ETFG`, `AR`, `NDAQ`). This is the first part of the datatable code. If the code is `MER/F1`, then `MER` is the publisher code and `F1` is the table code.
Table Code	`table`	`string`	The table code (e.g., `F1`, `FUND`, `MWCS`, `RTAT10`). This is the second part of the datatable code. If the code is `MER/F1`, then `F1` is the table code.
Columns	`columns`	`string[]`	Select a value from the drop down menu.
Row Filters	`filters`	`object`	Filter rows based on column values. Use column names as keys and values to filter by. For example: `{ "ticker": "SPY", "date": "2024-01-01" }`. Only filterable columns can be used (check table metadata).
Filter Operators	`filterOperators`	`object`	Apply operators to filters. Format: `{ "column.operator": "value" }`. Available operators: `.gt` (greater than), `.lt` (less than), `.gte` (greater than or equal), `.lte` (less than or equal). Example: `{ "date.gte": "2024-01-01", "date.lte": "2024-12-31" }`

Action Authentication#

Nasdaq Data Link (Time Series and Table data) uses API keys for authentication. When you connect your Nasdaq Data Link (Time Series and Table data) account, Pipedream securely stores the keys so you can easily authenticate to Nasdaq Data Link (Time Series and Table data) APIs in both code and no-code steps.

To retrieve your API Key,

Navigate to your Nasdaq Data Link account and sign in
Click the dropdown on the top right
Go to “Account Settings”

About Nasdaq Data Link (Time Series and Table data)#

Nasdaq Data Link is a powerful, centralized, cloud-based technology platform providing access to more than 250 trusted data sets, available via API. Search, discover and build.