Integrate the Kaggle API with the Data Stores API

Setup the Kaggle API trigger to run a workflow which integrates with the Data Stores API. Pipedream's integration platform allows you to integrate Kaggle and Data Stores remarkably fast. Free for developers.

Popular Kaggle and Data Stores Actions#

Add or update a single record with the Data Stores API

Add or update a single record in your Pipedream Data Store.

Try it

Add or update multiple records with the Data Stores API

Add or update multiple records to your Pipedream Data Store.

Try it

Append to record with the Data Stores API

Append to a record in your data store Pipedream Data Store. If the record does not exist, a new record will be created in an array format.

Try it

Check for existence of key with the Data Stores API

Check if a key exists in your Pipedream Data Store or create one if it doesn't exist.

Try it

Delete a single record with the Data Stores API

Delete a single record in your Pipedream Data Store.

Try it

Overview of Kaggle#

The Kaggle API allows you to harness a trove of data science and machine learning resources. With this API, you can download datasets, make competition submissions, and interact with Kaggle forums directly. By leveraging Pipedream's capabilities, you can automate repetitive tasks, integrate Kaggle with other applications, and create custom workflows to augment your data science projects.

Connect Kaggle#

import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    kaggle: {
      type: "app",
      app: "kaggle",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://www.kaggle.com/api/v1/datasets/list`,
      auth: {
        username: `${this.kaggle.$auth.username}`,
        password: `${this.kaggle.$auth.api_key}`,
      },
      params: {
        "": ``,
      },
    })
  },
})

Overview of Data Stores#

Data Stores are a key-value store that allow you to persist state and share data across workflows. You can perform CRUD operations, enabling dynamic data management within your serverless architecture. Use it to save results from API calls, user inputs, or interim data; then read, update, or enrich this data in subsequent steps or workflows. Data Stores simplify stateful logic and cross-workflow communication, making them ideal for tracking process statuses, aggregating metrics, or serving as a simple configuration store.

Connect Data Stores#

export default defineComponent({
  props: {
    myDataStore: {
      type: "data_store",
    },
  },
  async run({ steps, $ }) {
    await this.myDataStore.set("key_here","Any serializable JSON as the value")
    return await this.myDataStore.get("key_here")
  },
})