disco_core
try this, please
use disco_core;
SELECT * FROM TABLE(INFORMATION_SCHEMA.TASK_HISTORY())
where NAME = 'my_info_schema_task6'
order by COMPLETED_TIME DESC;
Still nothing
can we make a huddle?
Yes, sure
Cassiano caught me up on the current state. Do you have anyone else on your team who’s familiar with the Snowflake configuration of the task history table? I believe you can modify the retention on that table (perhaps on a per-role basis), and I also can’t reproduce the issue on our instance. The Snowflake team directed us to use that table as a reference for failed tasks, so you may need to adjust the retention on that table or modify the configuration in some way to get it working
But this does not look like an issue with the Pipedream source, so I’d recommend going that route — Snowflake can probably assist better than we can
OK. Let me give it a try
I did find that running this query:
SELECT *
FROM snowflake.account_usage.task_history
where NAME = ‘MY_INFO_SCHEMA_TASK6’
order by COMPLETED_TIME DESC;
Gave me all failed tasks
Here is a reference TASK_HISTORY | Snowflake Documentation
is that query subtly different than the one we’re constructing? It looks here like task history retention may not be the core issue if we’re able to see all failed tasks
the new sql sahred by is selecting for a table, we are using a function, maybe that function is using this table, need to investigate, the doc is the same
Ok. Should I stand by while you investigate?
Hey . I will comeback with some news today
Sounds good. Thank you
Hey . I can see all my executed tasks here using your query, I will update the action and adapt it to use the new query. Hopefully, this may fix your problem. I will let you know when the PR is done. But probably tomorrow. Thanks for you patience
One thing, this query just works using accountadmin
role. So, when using it in Pipedream, make sure to select this role or some role with these permisions
Sounds good. Thanks