cloudflare-scrape
cloudflare-scrape copied to clipboard
cloudflare-scrape is not able to bypass cloudflare checkings of this page https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest
Have upgrade cfscrape using this command pip install -U cfscrape
$ node --version v14.15.4
https://www.ricardo.ch is actually using anti-bot protection by Cloudflare
Please confirm the following statements and check the boxes before creating an issue:
- [X] I've upgraded cfscrape with
pip install -U cfscrape - [X] I'm using Node version 10 or higher
- [X] The site protection I'm having issues with is from Cloudflare
- [X] I'm not using Tor, a VPN, or an anonymizing proxy
Python version number
$ python --version Python 3.9.1
cfscrape version number
$ pip show cfscrape Name: cfscrape Version: 2.1.1 Summary: A simple Python module to bypass Cloudflare's anti-bot page. See https://github.com/Anorov/cloudflare-scrape for more information. Home-page: https://github.com/Anorov/cloudflare-scrape Author: Anorov Author-email: [email protected] License: UNKNOWN Location: c:\users\user\appdata\local\programs\python\python39\lib\site-packages Requires: requests Required-by:
Code snippet involved with the issue
import cfscrape
scraper = cfscrape.create_scraper(delay=15)
html = scraper.get("https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest").content
print(html)
Complete exception and traceback
In response I see cludflare's message contains like below
If you are on a personal connection, like at home, you can run an anti-virus scan on your device to make sure it is not infected with malware.
If you are at an office or shared network, you can ask the network administrator to run a scan across the network looking for misconfigured or infected devices.
URL of the Cloudflare-protected page
[https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest]
URL of Pastebin/Gist with HTML source of protected page
https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest