botasaurus icon indicating copy to clipboard operation
botasaurus copied to clipboard

examples: captcha on every request to g2

Open tobwen opened this issue 1 year ago • 1 comments

summary

Seems like the examples are outdated... Every example with g2.com lead to a captcha:

image

code used

from botasaurus.browser import browser, Driver

@browser
def scrape_heading_task(driver: Driver, data):
    driver.google_get("https://www.g2.com/products/github/reviews.html?page=5&product_id=github", bypass_cloudflare=True)
    driver.prompt()
    heading = driver.get_text('.product-head__title [itemprop="name"]')
    return heading

scrape_heading_task()

versions

At the time of writing, I'm on latest revision of the library and Chrome on Debian Linux (Python 3.11).

addition information

IP is not blocked. "Normal" browsers (Firefox, LibreWolf, Chrome directly started) work.

tobwen avatar Sep 14 '24 02:09 tobwen

Same issue for me

aandrewmolt avatar Sep 22 '24 15:09 aandrewmolt

Try this

@browser(remove_default_browser_check_argument=True,) def run_bot_tests(driver: Driver, _): driver.google_get("https://www.g2.com/products/github/reviews") driver.prompt()

run_bot_tests()

Chetan11-dev avatar Mar 06 '25 09:03 Chetan11-dev