We are a leader in #DataIntegration and #DataManagement – taking the work out of working with data.
List all plan executions the user is granted visibility on. For each plan execution returns execution and plan identifiers, start and finish timestamps, execution status and counters on done and planned executables within plan. See the documentation.
Get detailed status of one plan execution. See the documentation.
The Talend API provides a robust toolkit for data integration and management, enabling the automation of tasks such as data extraction, transformation, and loading (ETL). By leveraging the Talend API within Pipedream, you can create intricate workflows that automate data operations, integrate with various data sources, and orchestrate data pipelines. It's a tool designed for data professionals seeking to streamline data processes and ensure data quality across their systems.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
talend: {
type: "app",
app: "talend",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.${this.talend.$auth.endpoint}.cloud.talend.com/account/users`,
headers: {
Authorization: `Bearer ${this.talend.$auth.persona_access_token}`,
"Accept": `application/json`,
},
})
},
})
Snowflake offers a cloud database and related tools to help developers create robust, secure, and scalable data warehouses. See Snowflake's Key Concepts & Architecture.
Snowflake recommends you create a new user, role, and warehouse when you integrate a third-party tool like Pipedream. This way, you can control permissions via the user / role, and separate Pipedream compute and costs with the warehouse. You can do this directly in the Snowflake UI.
We recommend you create a read-only account if you only need to query Snowflake. If you need to insert data into Snowflake, add permissions on the appropriate objects after you create your user.
Visit https://pipedream.com/accounts. Click the button to Connect an App. Enter the required Snowflake account data.
You'll only need to connect your account once in Pipedream. You can connect this account to multiple workflows to run queries against Snowflake, insert data, and more.
Visit https://pipedream.com/new to build your first workflow. Pipedream workflows let you connect Snowflake with 1,000+ other apps. You can trigger workflows on Snowflake queries, sending results to Slack, Google Sheets, or any app that exposes an API. Or you can accept data from another app, transform it with Python, Node.js, Go or Bash code, and insert it into Snowflake.
Learn more at Pipedream University.
import snowflake from '@pipedream/snowflake';
export default defineComponent({
props: {
snowflake,
},
async run({ $ }) {
// Component source code:
// https://github.com/PipedreamHQ/pipedream/tree/master/components/snowflake
return this.snowflake.executeQuery({
sqlText: `SELECT CURRENT_TIMESTAMP()`,
binds: [],
});
},
});