Why am I Facing Memory Issues in Pipedream's Basic Plan with 10GB Memory While Running a Workflow?

This topic was automatically generated from Slack. You can find the original thread here.

I am running into memory issue while running a workflow. I do have a basic plan in pipedream with a memory of 10GB, but still running into the memory issue. Can anyone please help?

Maybe it’s not a memory issue at all, and the file is just too large (as described in the error message).

You could use a bash step to output the file size.

This command should do it: wc -c somefile.txt

It will output the file size in bytes.

And the max file size of 200mb is 209715200 bytes.

with the paid version you get to load a file size of 10GB. After i upgraded to the paid version i also generated a new API secret key. but not sure why it continues to generate the error

the URL in the error explains the upgrade to 10GB

memory and file size are not the same thing.

Maybe check the size of the file first, then we’ll know for sure.

can you go to your project settings and share your project with support? Happy to look into it

It does look like it may be a limitation from the 3rd party API (and not Pipedream), maybe this is a Thomas Frank’s workflow template?