Should I Fetch GitHub Repo Updates in a Single Step or Make Each Fetch its Own Step in Pipedream?

1

This topic was automatically generated from Slack. You can find the original thread here.

hello everyone, new to pipedream. have a question: i have a spreadsheet with info on a few hundred github repos. once a week, i want to fetch/update info about whether each one has been updated. should i do all the requests inside a single step, or try to make each fetch its own step?

2

If you can code, it will be more efficient to do it all in one workflow, or maybe even one step.

3

Otherwise, you might want to send each repo as an event to be processed to a workflow.

So two workflow:
• Workflow 1 reads your sheet, and triggers workflow 2 for each repo
• Workflow 2 processes the repo.

4

You might also consider using the data store to save info about the repos.

5

i’m trying to stay within the free quota which makes 1 workflow per repo (for a few hundre repos) a bit iffy. it seems doable in one step, just gotta add some waiting respect the rate limit. thank you for the reply