How to Download a File from an API and Upload It to Another API in a Pipedream Workflow Without Using 'tmp' Directory or File Store?

Help
21

Does Pipedream ever plan to support returning files from steps? That seems much easier

22

Yeah exactly, code steps allow you to do whatever isn’t natively implemented yet.

23

Does Pipedream ever plan to support returning files from steps? That seems much easier
Most likely this would be done through saving the file to /tmp and returning the path of the file.

24

Like in this case:

image.png
image.png257×148 6.7 KB

25

What’s the app you’re downloading the file from?

26

I see :thinking_face: I’m downloading call recordings from RingCentral and trying to upload them to Google Drive

27

So you do have this Download Recording option:

image.png
image.png441×576 33 KB

28

I see this, but what about uploading it?

I also would like to download transcripts and faxes, which are not on this list :disappointed:

29

image.png
image.png389×534 56 KB

30

image.png
image.png408×254 16.6 KB

31

Not to be difficult, but Google Drive is only one of the many apps I’d like to upload files to. Some of the apps are CRMs and such, and not all have these options - this is why I avoided giving specific apps in my original question.

Is there a generic and straightforward way to access a file and send it in an HTTP request?

32

You can create a request for Pipedream to add transcripts & faxes here. They’re usually pretty quick.

image.png
image.png292×251 13.6 KB

33

Or is it just putting them in tmp via a node code block and then reading/uploading them the same way?

34

Also (sorry for the barrage of questions and thank you for your patience) Since I’ll be using end user auth, I may be downloading/uploading multiple files at once. Is the tmp local to each workflow run?

35

It is local to each worker, yes.

Even if you handle multiple requests/events in parallel, each request will have its own worker and its own /tmp folder.

36

Oh that’s great :star-struck:

37

BUT

A worker can be reused for a subsequent request.

So it’s important to clean up any leftovers in /tmp.

38

I see, so once I upload the file to the target app, I should delete it from tmp

39

Is there a generic and straightforward way to access a file and send it in an HTTP request?
No, since authentication will vary from one API to the next.

Or is it just putting them in tmp via a node code block and then reading/uploading them the same way?
If there are no pre-built actions, that is indeed the only way.

40

I’ll experiment with using the node code blocks to access and upload the files, then.

I do hope Pipedream adds support to easily access files from tmp when building requests in existing actions, sort of like how we can access request and step data via the step’s path - it would be a game changer I think!

Thank you very much for all your help and I hope you have a great weekend. :slightly_smiling_face: