This topic was automatically generated from Slack. You can find the original thread here.
what does the error EMFILE: too many open files, scandir ‘/tmp/pds’ mean?
The error “EMFILE: too many open files, scandir ‘/tmp/pds’” indicates that your workflow is trying to open too many files simultaneously. To resolve this issue, you can try closing files after you’re done using them or limit the number of files you’re opening at once. If you’re processing a large number of files, consider using a streaming approach or processing them in smaller batches.
Are you using custom code or Pipedream actions in the step throwing the error?
custom code i think it was a result of passing an incomplete payload to a subsequent workflow while doing manual testing
i have concurrency limited to 1 on the receiving workflow and i think the error resulted in a domino effect of errors by breaking concurrency for some reason. just fixed the bug and got the payload formatted correctly and it looks like its working as expected now
may want to look into that though - i dont think this happens during a live deployment (but also not going to test it, lol), but did while testing out of the builder