botasaurus icon indicating copy to clipboard operation
botasaurus copied to clipboard

detect_and_bypass_cloudflare function does not work with widget hidden in shadow-dom

Open shtamtails opened this issue 1 year ago • 1 comments

I am trying to solve captcha on website, I've tried to use detect_and_bypass_cloudflare and failed, so I found out that they hide cloudflare widget in shadow-dom, iframe is encapsulated in shadow-dom and can't be accessed from main DOM

As far as I know selenium already has a feature that allows to access shadow-dom, would be great to see this feature in your library, thanks.

shtamtails avatar Jul 14 '24 23:07 shtamtails

assume this project has been abondon

WTFWITHTHISNAMESHIT avatar Jul 16 '24 08:07 WTFWITHTHISNAMESHIT

Resolved

  1. Updates packages python -m pip install bota botasaurus botasaurus-api botasaurus-requests botasaurus-driver bota botasaurus-proxy-authentication botasaurus-server botasaurus-humancursor --upgrade

  2. Run

from botasaurus.browser import browser, Driver

@browser
def scrape_heading_task(driver: Driver, data):
    driver.google_get("https://nopecha.com/demo/cloudflare", bypass_cloudflare=True)
    driver.prompt()

scrape_heading_task()

Chetan11-dev avatar Apr 10 '25 08:04 Chetan11-dev