Does Pipedream Have a Functionality to Monitor Workflows and Send Slack Alerts for Inactivity?

Help
1

This topic was automatically generated from Slack. You can find the original thread here.

Just wondering if there was any functionality in Pipedream which can monitor workflows and alert with a Slack message if there haven’t been any invocations within a set period of time? E.g. If we have a workflow that should be expected to be running multiple times a day, it would be good to get a warning if for some reason it hasn’t been invoked for 24 hrs, as that might indicate a problem (e.g. with a source or something else).

2

Hi , So far, there’s no built-in functionality as you described. However, you can build a custom workflow to achieve that.

Assuming you have workflow A that needs monitoring:

  1. Add the final step of your workflow to add workflow execution status to a Datastore. So that whenever it is executed successfully, there’ll be a new record with the execution time added to the Datastore
  2. Then create a new workflow B:
    a. Add a step to get the latest records from the data store.
    b. Add the Filter step to continue the workflow when the execution time in that record is 1 day ago (meaning that the workflow hasn’t been executed successfully for 1 day)
    c. Add the step to send a message to Slack, email and such
    I think this needs sufficient coding knowledge to implement. If you’re unsure that you can implement your use case, you can:
  3. Read more about Pipedream Node.js document here and watch Pipedream University series to understand how Pipedream works
  4. Read more about Javascript, especially Node.js part. Also, you can watch through Pipedream speedrun series to have more references
  5. Submit a ticket for Pipedream, stating the improvement that you want
  6. If you’d like to hire a Pipedream expert for your usecase, feel free to use this link: Connect with a Pipedream Partner
3

Can you file it as feedback then for adding as a product feature? I don’t have time at the mo to write a workflow to monitor a workflow

4

, I can help you fire the ticket, but please note that the ticket will be subject to prioritization from the Pipedream team.

5

Here’s the ticket: [FEATURE] Notification for workflow does not process event for a duration · Issue #9041 · PipedreamHQ/pipedream · GitHub

6

Hi you can build your own workflow to montior another using the REST API.

You can emit an event from your workflow at the very end in a Node.js code step, then using this secondary monitoring workflow you can poll the Pipedream REST API and make sure emits have been received in the reasonable time period:

7

Btw this is definitely something we’ve discussed internally and would definitely make a cool feature! We write a lot of these internal workflows, mainly to monitor other services, but same concept.

8

We’d use that feature as well! :+1: