We are a leader in #DataIntegration and #DataManagement – taking the work out of working with data.
List all plan executions the user is granted visibility on. For each plan execution returns execution and plan identifiers, start and finish timestamps, execution status and counters on done and planned executables within plan. See the documentation.
Get detailed status of one plan execution. See the documentation.
The Talend API provides a robust toolkit for data integration and management, enabling the automation of tasks such as data extraction, transformation, and loading (ETL). By leveraging the Talend API within Pipedream, you can create intricate workflows that automate data operations, integrate with various data sources, and orchestrate data pipelines. It's a tool designed for data professionals seeking to streamline data processes and ensure data quality across their systems.
import { axios } from "@pipedream/platform"
export default defineComponent({
props: {
talend: {
type: "app",
app: "talend",
}
},
async run({steps, $}) {
return await axios($, {
url: `https://api.${this.talend.$auth.endpoint}.cloud.talend.com/account/users`,
headers: {
Authorization: `Bearer ${this.talend.$auth.persona_access_token}`,
"Accept": `application/json`,
},
})
},
})
The Filter API in Pipedream allows for real-time data processing within workflows. It's designed to evaluate data against predefined conditions, enabling workflows to branch or perform specific actions based on those conditions. This API is instrumental in creating efficient, targeted automations that respond dynamically to diverse datasets. Using the Filter API, you can refine streams of data, ensuring that subsequent steps in your Pipedream workflow only execute when the data meets your specified criteria. This cuts down on unnecessary processing and facilitates the creation of more intelligent, context-aware systems.
export default defineComponent({
async run({ steps, $ }) {
let condition = false
if (condition == false) {
$.flow.exit("Ending workflow early because the condition is false")
} else {
$.export("$summary", "Continuing workflow, since condition for ending was not met.")
}
},
})