cloudflare-scrape icon indicating copy to clipboard operation
cloudflare-scrape copied to clipboard

IP blocked after 40 proxied calls

Open dwcar49us opened this issue 5 years ago • 0 comments
trafficstars

Before creating an issue, first upgrade cfscrape with pip install -U cfscrape and see if you're still experiencing the problem. Please also confirm your Node version (node --version or nodejs --version) is version 10 or higher. (12+)

Make sure the website you're having issues with is actually using anti-bot protection by Cloudflare and not a competitor like Imperva Incapsula or Sucuri. And if you're using an anonymizing proxy, a VPN, or Tor, Cloudflare often flags those IPs and may block you or present you with a captcha as a result.

Please confirm the following statements and check the boxes before creating an issue:

  • [ x] I've upgraded cfscrape with pip install -U cfscrape
  • [ x] I'm using Node version 10 or higher
  • [x ] The site protection I'm having issues with is from Cloudflare
  • [x ] I'm not using Tor, a VPN, or an anonymizing proxy

I am using https://stormproxies.com/ Backconnect rotating proxies. These have worked in the past - 6 months ago. The proxy rotates on each call.

It seems like Cloudflare may be profiling the proxy and then blocking all calls with that profile. The first two instances ran for about 50 queries before they were blocked. The 5th and 6th instances of the scraper were immediately blocked, so the proxies must have been detected somehow. The rotating proxy pool is over 70k proxies.

I don't know if you can help or recommend a proxy service that still works.

Python version number

Run python --version and paste the output below:

Python 3.7.1 (default, Dec 10 2018, 22:54:23) [MSC v.1915 64 bit (AMD64)] :: Ana conda, Inc. on win32


cfscrape version number

Run pip show cfscrape and paste the output below:

Name: cfscrape
Version: 2.1.1
Summary: A simple Python module to bypass Cloudflare's anti-bot page. See https:
//github.com/Anorov/cloudflare-scrape for more information.
Home-page: https://github.com/Anorov/cloudflare-scrape
Author: Anorov
Author-email: [email protected]
License: UNKNOWN
Location: c:\anaconda3\lib\site-packages
Requires: requests
Required-by:

Code snippet involved with the issue


Complete exception and traceback

(If the problem doesn't involve an exception being raised, leave this blank)


URL of the Cloudflare-protected page

http://socialblade.com/youtube/c/UCYUY1iZP9t6LFbBMg_QOPAA/monthly

URL of Pastebin/Gist with HTML source of protected page

[LINK GOES HERE]

dwcar49us avatar Jun 25 '20 07:06 dwcar49us