botasaurus
botasaurus copied to clipboard
The All in One Framework to build Awesome Scrapers.
CF with JS challenge blocks access when running in docker container. Same simple app has no problem when run on Windows (headless true or false)
Hi! When I make a request with use_stealth=True the content of the response is different from the same request without use_stealth. Example of the first 20 characters of the content:...
When I run the docker service on a real server and make a request, I get the following error. However, when I run it on my local computer, this error...
Hello, I would like to know where the Dockerfile is located so that I can update the packages on my end. Thanks.
> result = run_parallel(run, used_data, n) at wrapper_browser (/home/user/.local/lib/python3.10/site-packages/botasaurus/decorators.py:664) > parallel_thread.join(0.2) # time out not to block KeyboardInterrupt at run_parallel (/home/user/.local/lib/python3.10/site-packages/botasaurus/decorators.py:166) > raise self._exception at join (/home/user/.local/lib/python3.10/site-packages/botasaurus/decorators.py:152) > self.result =...
Hi, I used the code to login tw after my account was logged out. But it seems twitter has discovered something. After a few attempts, my account was suspended. Can...
Reading package lists... Building dependency tree... Reading state information... nodejs is already the newest version (18.19.0+dfsg-6~deb12u1). 0 upgraded, 0 newly installed, 0 to remove and 30 not upgraded. v18.19.0 ```...
How can we resolve this error. Any clue ? [botasaur_code.zip](https://github.com/omkarcloud/botasaurus/files/14754956/botasaur_code.zip)
``` File "/usr/local/lib/python3.11/dist-packages/botasaurus-4.0.3-py3.11.egg/botasaurus/decorators.py", line 651, in wrapper_browser current_result = run_task(data_item, False, 0) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/botasaurus-4.0.3-py3.11.egg/botasaurus/decorators.py", line 531, in run_task driver = create_selenium_driver(options, desired_capabilities) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/dist-packages/botasaurus-4.0.3-py3.11.egg/botasaurus/create_driver_utils.py", line 236, in create_selenium_driver...
iam getting this error : **venv\Lib\site-packages\botasaurus\got_adapter.py", line 138, in _convert_to_got_request raise ValueError(f"{key} is not Supported") ValueError: json is not Supported** from this line : `driver=bt.create_requests(use_stealth=True)` `response=driver.post('https://woovin.com/wp-admin/admin-ajax.php',payload,headers=custom_headers)` the headers and payload...