cloudflare-scrape icon indicating copy to clipboard operation
cloudflare-scrape copied to clipboard

cloudflare-scrape is not able to bypass cloudflare checkings of this page https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest

Open deb4it opened this issue 3 years ago • 0 comments

Have upgrade cfscrape using this command pip install -U cfscrape

$ node --version v14.15.4

https://www.ricardo.ch is actually using anti-bot protection by Cloudflare

Please confirm the following statements and check the boxes before creating an issue:

  • [X] I've upgraded cfscrape with pip install -U cfscrape
  • [X] I'm using Node version 10 or higher
  • [X] The site protection I'm having issues with is from Cloudflare
  • [X] I'm not using Tor, a VPN, or an anonymizing proxy

Python version number

$ python --version Python 3.9.1

cfscrape version number

$ pip show cfscrape Name: cfscrape Version: 2.1.1 Summary: A simple Python module to bypass Cloudflare's anti-bot page. See https://github.com/Anorov/cloudflare-scrape for more information. Home-page: https://github.com/Anorov/cloudflare-scrape Author: Anorov Author-email: [email protected] License: UNKNOWN Location: c:\users\user\appdata\local\programs\python\python39\lib\site-packages Requires: requests Required-by:

Code snippet involved with the issue

import cfscrape scraper = cfscrape.create_scraper(delay=15)
html = scraper.get("https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest").content print(html)

Complete exception and traceback

In response I see cludflare's message contains like below

If you are on a personal connection, like at home, you can run an anti-virus scan on your device to make sure it is not infected with malware.

If you are at an office or shared network, you can ask the network administrator to run a scan across the network looking for misconfigured or infected devices.

URL of the Cloudflare-protected page

[https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest]

URL of Pastebin/Gist with HTML source of protected page

https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest

deb4it avatar May 16 '22 16:05 deb4it