botasaurus
botasaurus copied to clipboard
The All in One Framework to build Awesome Scrapers.
When i start my program without any compilation it's working well, but when i compile and try to use proxy my exe start adding packages and never works ``` _added...
When I try to scrape the https://geniusee.com/single-blog/fintech-regulation-legal-and-regulatory-aspects with browser decorator. The botosaurus just paused there. When analysed I have turned off load images and css and the target website tries...
Browser hangs on alert() triggered via redirect script – need timeout or way to suppress JS alerts
Hi Botasaurus team 👋 I’m encountering an issue where visiting certain URLs causes the browser to hang indefinitely. Here’s a minimal example of the HTML content being served: ``` Redirect...
#代碼 from botasaurus.browser import browser, Driver from botasaurus.soupify import soupify @browser( #tiny_profile=True, profile="pikachu", ) def scrape_data(driver: Driver, link: str): driver.get(link, bypass_cloudflare=True) response = soupify(driver) link = "" scrape_data(link) #結果 Running...
Hi, thank you for this awesome project! I'm trying to deploy botasaurus on a server and run it in headful mode (non-headless), because I need to bypass Cloudflare bot protection,...