Is there any way to improve bot detection from Lightpanda's CDP?

[superphao]

I'm using Playwright and connecting CDP to Lightpanda which is deployed on a container using Docker, but I'm facing a problem that I haven't found a solution for yet - I'm being detected as a bot.

The problem lies in the CDP connection from Playwright, the other parts work normally. Are there any suggestions for this case?

Thanks

[krichprollsch]

Hello @superphao,

Did you make the same test w/ chromium? Isn't Playwright itself exposed?

FTR here is the url: https://www.browserscan.net/bot-detection

[krichprollsch]

On chrome, opening the console makes you detected as bot...

[krichprollsch]

When testing w/ Lightpanda I have a js error + not loaded result.

WARN  js : evaluate module . . . . . . . . . . . . . . . . .  [+107.252s]
      specifier = https://www.browserscan.net/dist/D0os_Hrt.js
      message = TypeError: Cannot read properties of undefined (reading 'baseURL')

WARN  user_script : eval script . . . . . . . . . . . . . . . [+107.252s]
      url = https://www.browserscan.net/dist/D0os_Hrt.js
      err = unknown
      cacheable = true

[superphao]

Thank you for the response.

I'm using it with a Chrome instance via CDP and it's also being detected similarly. I've tried many ways to avoid detection with Playwright but it hasn't been successful, so I thought the browser might have a solution.

But it seems quite difficult as well - most libraries that pass bot detection all use Chrome path. I haven't been able to find a solution for the CDP connection yet.