How to Use Playwright on Pipedream and Bypass Cloudflare Detection?

This topic was automatically generated from Slack. You can find the original thread here.

Hello, this is a shot in the dark, but I hoping I could get some pointers on using Playwright on Pipedream.
I’m experiencing issues with Cloudflare detection. Is this an unavoidable problem or does anyone have experience getting around this?

Hi , have you seen our guide at https://pipedream.com/docs/code/nodejs/browser-automation#playwright ?

You should be able to whitelist the IP of your Pipedream VPC in Cloudflare.

Hey , thanks for the quick response.
Thanks for the resource. I initially dismissed it but this section seems interesting. Browser Automation with Node.js - Pipedream
Perhaps I can create a custom user agent here to help bypass detection.
I’ll test it out. Thanks!

Yeah since you can pass any standard options to Playwright I think that’s a good idea. Marco’s suggestion is also good since the Cloudflare detection is probably based on IP

It’s not my site I’m trying to access.
For context, I’m automating posts for a client on Cicle.so
Their API isn’t fully featured, so I’m resorting to Puppeteer/Playwright. Thanks for the suggestion

Cloudflare detection is notoriously hard to bypass, so good luck! :crossed_fingers:

You might want to talk to their team in order to figure out the best option.

A little custom user and a proxy and we’re in :wink:
Appreciate the support and @U05LWJMUX0A!

We’re switching over from Zapier just for this. Now that it’s verified to work on a free plan, perhaps I won’t even need a proxy using a VPS!