Does Pipedream work for a puppeteer nodejs app?

Help
, , ,
2

Hi @kwachter,

First off, welcome to the Pipedream community. Happy to have you!

Yes I personally use Pipedream for scraping data from APIs and inserting them into my MongoDB instance for analysis.

One caveat with puppeteer specifically is that it’s not 100% compatible with our infrastructure. You can follow along with the developments on this issue and workarounds other Pipedreamers have found here:

Another alternative is to use a Python step in a v2 workflow to use BeautifulSoup to parse scraped HTML.

I hope this helps!