Mohammed Zeeshan : Hey Dylan!
I just got to know about Pipedream’sSQL service just today, isn’t that something similar to the tools you mentioned above? Basically, i just needed some glue service between workflows. I am using Airtable just for storing some id’s and user interests.
One more question: can i refer to this SQL db between 2 different workflows?
Dylan Sather (Pipedream) : You can definitely use the SQL service, and yes - you can write to / read from a single table across workflows. There are two limitations to the SQL Service I’ll make you aware of (which is why we don’t recommend it for this use case). If you’re OK with those limitations then it certainly might work for you:
• The SQL service is append-only. You can only write records to it, and can’t update or delete records.
• Using $checkpoint is fast (the data are loaded into the memory of your workflow, so you don’t make an API call to fetch / mutate the data). The SQL service isn’t optimized for speed and can take many seconds to return results. For high-volume workflows, this can cause you to hit the daily compute time limit of 30 minutes.
Feel free to experiment with it and see if it works for you, though!
Mohammed Zeeshan : Thank You for explaining this This understanding was very important!
Do Pipedream plan to offer some more robust storage in future like other tools have currently? (Zapier Storage, Integromat Datastore)