About multiple schemas check, yeah, this is totally possible. I will start to work on this.
About Regex, It was in QA, but QA returned due some inconsistencies in the solution, You can check the current status here: https://github.com/PipedreamHQ/pipedream/pull/6736
I expect having both ready for review at Monday max
It looks like the fix is working. Thank you.
On another note. Having ability to check for failed tasks in all schemas would catch tasks created in new schemas automatically.
you can find the regex and schemas list in this PR: [Source] Snowflake - Add regex to getFailedTasksInDatabase by vellames · Pull Request #6736 · PipedreamHQ/pipedream · GitHub
Awesome. Thank you.
Hey . The PR was merged
You can use regex and multiple schemas
Thank you. Let me try it later today.
Posted thread to Discourse: Update on Pipedream Missing Tasks After Schedule Change from 15 Minutes to 6 Hours?
Hi @UMT4G7E5P I am trying to test regex for DB and Schema selection. Is there documentation link or a sample I can view? Thank you.
Posted thread to Discourse: Update on Pipedream Not Picking Up Missed Tasks After Schedule Change from 15 Minutes to 6 Hours?
Hello I just realized that some of our previous communication might have been a bit mixed up. Upon further understanding, I now realize that the regex fix is exclusively applied to the names of Snowflake tasks. While this is indeed great, I was actually hoping for the ability to use regex or wildcard selection for any Snowflake schema. My intention was to ensure that if any new schemas are created, this source would be able to detect them. Is it possible to implement this functionality? Thank you.
We can address this, sorry for the misunderstanding. It’s definitely interesting to think of other places we can apply regex matches like this
Let me know once you have this feature logged so I track it. Thank you.
will do, would you mind opening a new ticket and working on this whenever you wrap up whatever integration you’re working on now?
Sure, np