Now, with $.flow.rerun in Pipedream workflows, you can leverage the Shopify Bulk Operation API to perform big data queries in one workflow with ease.
The Shopify Bulk Operations API is a special job running API. It allows you to perform huge data queries via GraphQL without being limited by pagination.
However, the more difficult part of using this API is that you have to poll Shopify to ask for the current status of the job. This is because a job could take several minutes or even longer, depending on the amount of data you're asking for.
Thanks to the new $.flow.rerun in Node.js code steps, you can now poll Bulk Operations in the same workflow invocation.