scrapy-cloudflare-middleware cloudflare challenge 503 continue to occur after solving the first one

cloudflare challenge 503 continue to occur after solving the first one

Open partyspy opened this issue 5 years ago • 4 comments

It seems that your code snippet didn't handle the requests already in the scheduler queue while the concurrent one request challenged by cloudflare. Therefore even if a challenge is resolved, subsequent requests would still face challenges.

Mar 28 '19 13:03 partyspy

having this issue as well, here are my logs:

2019-06-28 13:35:55 [scrapy.utils.log] INFO: Scrapy 1.6.0 started (bot: crawler)
2019-06-28 13:35:55 [scrapy.utils.log] INFO: Versions: lxml 4.3.4.0, libxml2 2.9.9, cssselect 1.0.3, parsel 1.5.1, w3lib 1.20.0, Twisted 19.2.1, Python 3.7.3 (default, May 11 2019, 02:00:41) - [GCC 8.3.0], pyOpenSSL 19.0.0 (OpenSSL 1.1.1b  26 Feb 2019), cryptography 2.7, Platform Linux-5.1.15-arch1-1-ARCH-x86_64-with
2019-06-28 13:35:55 [scrapy.crawler] INFO: Overridden settings: {'AJAXCRAWL_ENABLED': True, 'AUTOTHROTTLE_ENABLED': True, 'AUTOTHROTTLE_MAX_DELAY': 10, 'AUTOTHROTTLE_TARGET_CONCURRENCY': 15.0, 'BOT_NAME': 'crawler', 'CONCURRENT_REQUESTS': 100, 'CONCURRENT_REQUESTS_PER_IP': 30, 'COOKIES_ENABLED': False, 'DEPTH_LIMIT': 2, 'DEPTH_PRIORITY': 1, 'DOWNLOAD_TIMEOUT': 20, 'LOG_FILE': 'logs/default/recursive_spider/a625e99499a911e9bcd934298f900aba.log', 'NEWSPIDER_MODULE': 'crawler.spiders', 'REACTOR_THREADPOOL_MAXSIZE': 30, 'REDIRECT_MAX_TIMES': 10, 'RETRY_ENABLED': False, 'SCHEDULER_DISK_QUEUE': 'scrapy.squeues.PickleFifoDiskQueue', 'SCHEDULER_MEMORY_QUEUE': 'scrapy.squeues.FifoMemoryQueue', 'SPIDER_MODULES': ['crawler.spiders'], 'TELNETCONSOLE_ENABLED': False}
2019-06-28 13:35:55 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.throttle.AutoThrottle']
2019-06-28 13:35:55 [recursive_spider] DEBUG: RecursiveSpider's start url was overridden with https://www.torrentday.com/
2019-06-28 13:35:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Android
2019-06-28 13:35:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV13, Brand: Sony, Model: BDV13
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Nintendo DSi, Brand: Nintendo, Model: DSi
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-06-28 13:35:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV14, Brand: Sony, Model: BDV14
2019-06-28 13:35:58 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: LG Web0S SmartTV, Brand: LG, Model: Web0S SmartTV
2019-06-28 13:35:58 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:58 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:58 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:58 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV11, Brand: Sony, Model: BDV11
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:35:59 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Nintendo DSi, Brand: Nintendo, Model: DSi
2019-06-28 13:36:00 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:36:00 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:36:00 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Applebot
2019-06-28 13:36:00 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:36:01 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Applebot
2019-06-28 13:36:01 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-06-28 13:36:01 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: SMTBot
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: WebKit Nightly
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:02 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:36:03 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:03 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-06-28 13:36:03 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Robot
2019-06-28 13:36:03 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-06-28 13:36:03 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Zune
2019-06-28 13:36:03 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy_cloudflare_middleware.middlewares.CloudFlareMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy_user_agents.middlewares.RandomUserAgentMiddleware',
 'scrapy.downloadermiddlewares.ajaxcrawl.AjaxCrawlMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2019-06-28 13:36:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawler.middlewares.StartRequestsMiddleware',
 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware']
2019-06-28 13:36:03 [scrapy.middleware] INFO: Enabled item pipelines:
['crawler.pipelines.scrapy_mongodb.MongoDBPipeline']
2019-06-28 13:36:03 [scrapy.core.engine] INFO: Spider opened
2019-06-28 13:36:03 [scrapy-mongodb-pipeline] INFO: Connected to MongoDB mongodb://user:[email protected]:27017, using "scrapy"
2019-06-28 13:36:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:36:03 [recursive_spider] INFO: Spider opened: recursive_spider
2019-06-28 13:36:03 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.94 Safari/537.36
2019-06-28 13:36:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://www.torrentday.com/login.php> from <GET https://www.torrentday.com/>
2019-06-28 13:36:03 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.86 Safari/537.36
2019-06-28 13:36:06 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:06 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:10 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=14a15bc6587d312d14ba88adf5946b6859035fda-1561728966-1800-AbNRLVSRkyNjmObM0dsWWSdrm61ViHmj8RpXyxPe462rrKl%2B1ccU4V8hged8lelggtbjVg1ZilwqCET%2FY1ae8hEHWD3NlcjJclpTcVpeagRDHbqrAN%2BSbQlKnOOnrsny10bFY7im%2FUigaG3p%2FS%2Bv8vU%3D&jschl_vc=023ed0d5e6ae860135a6435e85a9928a&pass=1561728970.941-kwfPWE1Jup&jschl_answer=31.8089354662 HTTP/1.1" 302 159
2019-06-28 13:36:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:11 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:11 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.11 (KHTML, like Gecko) Chrome/23.0.1271.97 Safari/537.11
2019-06-28 13:36:14 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:18 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=aaafb6608a16f68595cc17366e306712a7673652-1561728974-1800-Adh7AaUMfvG6T40yGEm51L64QZBXv%2BYIUFk03fbG2ESSmHZs4VWRZFMr2XT0lAVFUGcFPzue794UkDtDYz4d5Zaxvw5rFvQyqGPCb40SBVqgc2qg0eE4GxelG80AiG5qDUTVbJZNvabBIFF6aOFCdMk%3D&jschl_vc=db173891cc89493816c338b681b6c43c&pass=1561728978.257-aD7VkjJ2xp&jschl_answer=14.1633611252 HTTP/1.1" 302 159
2019-06-28 13:36:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:18 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:18 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
2019-06-28 13:36:20 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:21 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:25 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:25 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=1744c8baa4ba0876cade92df8017e10d9477d978-1561728981-1800-AU9YUqqtSMyi7mSkbD8N0ePgHpOyd4jT0Egjc7ySLUmno0IAevRCjom%2F4LEtkKgCkcO7bWM1pGelsmPxeq1WdC%2B4BMimstbs%2Fhzhja8Ed%2FHlzknWZvuoeqXUMIsS1klgcoyLeR1y0amtxGMRr6iOQok%3D&jschl_vc=3330555c4ae88bf6b8dbdb22ed991b25&pass=1561728985.032-D%2FcPFBm9xF&jschl_answer=18.0117289088 HTTP/1.1" 302 159
2019-06-28 13:36:25 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:25 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:25 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36
2019-06-28 13:36:27 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:27 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:31 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:31 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=e469e89bf49ff20d44627f3b0470542beda294fb-1561728987-1800-ASK3c%2BOvYZM81xriCd0uoscbNEqlDBaDDc5EkdKGuNFOc3l%2BrOqSr7SE2ULuXY%2BWiOrChSKaKJt4wqi889f9lHCmZDjtrnairttDA2PvRB1E6LtZ4ohAgLM9bYGVKK6TBaNHTdTV7BQ0ww%2BcO2iPjPU%3D&jschl_vc=3f0a851b9d0e51925b0e7e0f4cff4aa3&pass=1561728991.495-fa%2B5hI6zDF&jschl_answer=27.0484810512 HTTP/1.1" 302 159
2019-06-28 13:36:31 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:31 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:31 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.103 Safari/537.36
2019-06-28 13:36:34 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:34 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:38 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:38 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=3f136be2d3fad068e5645726231faf413094e9a9-1561728994-1800-AX43JCdfCgOUmHPSBkmKOhz70eNXXJMt9uQg6zaZei4q6argic%2FeEYrLHB6HAMS09i4V3tox1aTmgDigxoi3z6A1ucqwpgzQ%2FzlVHjDIjzbQ5%2FMVS4%2B4wUYk5qt2ite1OuuE%2BB2zaa47%2Bc%2FrmPa5mtk%3D&jschl_vc=2694aef6079d374e9880938bbe538e80&pass=1561728998.33-M2dnDnwNj1&jschl_answer=24.4746268179 HTTP/1.1" 302 159
2019-06-28 13:36:38 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:38 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:38 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.82 Safari/537.36
2019-06-28 13:36:41 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:45 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=d660cd9f1ce0effa530b53a283b88977dcc66b38-1561729001-1800-AQ1ZSLaPxxUSdSuiSBlIqLX%2BYGgw5TvSUPagy3oEpgYp5tgtgdfZab8syHB1Uh7e3fIGEb9Lxn%2BgJDYjIjvTjcGje0CsJi2TyBwLajvogBuGxxo1F8RaQ4KgTCzmjYgq%2Fnl%2BXQ1yxjVHpXUxkJ4gCdA%3D&jschl_vc=dfc552c4c3c84995f28c4369609a8caf&pass=1561729005.109-AYZ5EfxB%2FR&jschl_answer=-19.0517155835 HTTP/1.1" 302 159
2019-06-28 13:36:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:45 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:45 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.2526.111 Safari/537.36
2019-06-28 13:36:47 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:47 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:51 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=ec24d243972bd369d102b37f33b2ae5f22978556-1561729007-1800-Adhzl%2BP024lnAon6i03SEZLBK4eWYgXvqs8SJIylDUrA8QPNdy77vw7oVqXfCzcbPMnhDK2N7vvqoLp5irO6ls9bMrk8mFKvkXodnQvAxjmj9C2vmqcZExKLveC0nCReJPaYFfJxVv7Spqw8sMFwgj4%3D&jschl_vc=e40cf664ca438ebd238b5188f14c05c8&pass=1561729011.109-CZM9K13cYZ&jschl_answer=18.1586085045 HTTP/1.1" 302 159
2019-06-28 13:36:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:51 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:51 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.140 Safari/537.36
2019-06-28 13:36:53 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:36:53 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:36:57 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:36:58 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=4c3ec01a37ab9157ca1c3b9208552fbf8ee501dd-1561729013-1800-AS4WaktnNhqL3CoEmFlo8LAmXADFglsSyRUKkWsc1UNZC2GtohvCF0LrSgsdY9bSYvfHiKol17f95Pa2oIPJOEk%2Be3xIhEaTavepPwEegBrHsOJ%2Fap2t889CNW4sk1DY7zXJN3mSkCdGG8HTEZhFvkU%3D&jschl_vc=ce85f55e54718074115ca141f1f81466&pass=1561729017.966-LNTD2Al%2BjJ&jschl_answer=15.8313619564 HTTP/1.1" 302 159
2019-06-28 13:36:58 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:36:58 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:36:58 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.94 Safari/537.36
2019-06-28 13:37:01 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:01 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:05 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:05 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=562c63e21f5511de5bc98a9b84c6509b87d6b20f-1561729021-1800-ATVj1HQ8DUGQkNQ2S0duKQOhLvz5M8FLQ1wMWFwknE8qPzmYaIw9ltDR08ZEdFJqUTc8wVo3tMZVpbtFeJ1dZP56bNLGJGKviDewsH4%2B483KOsVFhTXtt%2Bbmg89hGrOwIqdrunBTsHdff11%2Fp8A2Hfw%3D&jschl_vc=9fdad85eff4e16f58a694942c1dbb518&pass=1561729025.379-dB22GQ0Wqr&jschl_answer=16.2313544974 HTTP/1.1" 302 159
2019-06-28 13:37:05 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:05 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:37:05 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.94 Safari/537.36
2019-06-28 13:37:08 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:08 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:12 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:12 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=24b239f95e67aa658e3befa0550b74000da47062-1561729028-1800-AcoGZ83jSg1oAKnrb3We%2B%2FjM9MY1NwvqxRiZUL2e%2BduJputQFOHFAqYMx2UGMvwJRKyAFsaUSv2a1hnfOGqWAIMZiE42jmyPlQQPwGnSe6QjClX5qTjS9S6iYhkFC0RH6bNY%2BuGg84y04jUeZRS4W2I%3D&jschl_vc=ceaad85009f0f8cddabc0e2981004f5c&pass=1561729032.798-i985mKAcpJ&jschl_answer=43.6792426250 HTTP/1.1" 302 159
2019-06-28 13:37:12 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:16 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:16 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=ee1d1a6545944efa1924ab971d00566aeba8f17f-1561729032-1800-ARcnK59BpqHpqmK7%2F9T8trviSnY%2BBRRZXosAScZ1XMp6i5hfZnUr%2BHYlu%2F%2B4aP0wLCwpV3fHFdUreO6ySHO5nvZ1ZdA8rpbo9eplUP%2BTv2R59TpIoFaSgX%2F%2F6H9Z8Tru2DFIfTAV0xAW%2BsVEUov7L8g%3D&jschl_vc=376f0ed23d2b45e213e98deca81d675c&pass=1561729036.889-ZmIN%2Bppx0b&jschl_answer=11.8442078711 HTTP/1.1" 302 159
2019-06-28 13:37:17 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:17 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:17 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.81 Safari/537.36
2019-06-28 13:37:17 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:17 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:21 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:21 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=b11261ac53419bde6d6d65a8766febbebd8f430f-1561729037-1800-AXSjXjx2bM5%2BxXxvGJsXxeZd75CKfr4PLAPlXQaSdWXg2ubn58Xj8TduN%2BjjY3BbkYG%2Bb5cf%2B6QSdbh8S6yXYndafe8NGwKSP0me91bn7ygvCEMo9qWSW9rTMNVpKALnLgkUT2p23eYT7drrTCFRqLk%3D&jschl_vc=d7f80ace5776b9c37078b0b69fd3e204&pass=1561729041.169-75SeYWNjbJ&jschl_answer=21.9466356421 HTTP/1.1" 302 159
2019-06-28 13:37:21 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:21 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:21 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.94 Safari/537.36
2019-06-28 13:37:22 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:22 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:26 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:26 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=3c9ce8354e5bbea3a55fa6a5df15c4de0c1e0586-1561729042-1800-AZd6L0n9ZSL%2BYpn82HjkucVmCVzgKEqkvl2Moe3saMcsbZyrBftGb5qRaqWzQ61Pf7NuV474CQZY67kb4wrC2hOyhnuCfbLKacvwqZRITJ7HVonwofP1cP2keIGIZOx%2Bw58pfG8Q5J45a7%2Fu7ZL9OiE%3D&jschl_vc=c655245748f38893b5b276ee596f8d2e&pass=1561729046.071-OCF3FjOfDs&jschl_answer=31.6688107276 HTTP/1.1" 302 159
2019-06-28 13:37:26 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:26 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:26 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.108 Safari/537.36
2019-06-28 13:37:29 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:29 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:33 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:33 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=41b9de420cc0f0b8e2d684f9dbc60e95a1e74782-1561729049-1800-AaOap6cTevrcW8oB5mbClQXR3QC8GN2vX28RQAJJHT%2BB973Z5JJ%2FEOn8eUT%2BPTXCAYQn%2BNlq7rejOnB3D68s63UA%2BzAWW2AOsHJPEVdUenAsVzskN2bh35nY81qHZYfbYGhKnUoDS6ltJlXrJ3bdoZE%3D&jschl_vc=30079381b028e2e5df08c47fea6cc7ea&pass=1561729053.36-TFynOWBNLh&jschl_answer=29.5543137019 HTTP/1.1" 302 159
2019-06-28 13:37:33 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:33 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:33 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.117 Safari/537.36
2019-06-28 13:37:35 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:35 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:39 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:39 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=6dbaa4c5dc5793d8d3100b4f65be3919dac3e0ad-1561729055-1800-Abaoc6aQydSkFngX2BTMZaI08LiGaSoNF4yirJ%2Fze7M2H0mfRxE2%2Bie8LZYA1GHixyvhR%2BI6DoVbrcWxZTh0e1M8uYN8nj0pxhNyE%2BfLua9uki%2B6MtWgirBvlnMMel952Q2sAVW%2FMzFXAtdIRburNDA%3D&jschl_vc=052622270c539d1f46be171e56696228&pass=1561729059.474-1N%2Ftd5NvXq&jschl_answer=45.4663876991 HTTP/1.1" 302 159
2019-06-28 13:37:39 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:39 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:39 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.89 Safari/537.36
2019-06-28 13:37:40 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:45 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=4cfa982b89c939e9042c0ae61b85f67cb0c16010-1561729061-1800-Aczoq4Jbl5wSM9I0zglJxJMFs3dKdbBM719vpQdFExAsPlMOb6kwk14apLnN%2BgB%2BhJFdQiblnLZfadPmGrPePH5tqCP8AkHd7CTq5eJBt2qrnSFeuqPLVpKqB3SeXvPb%2B0nLRFdzryDl1zPNrAjR5q8%3D&jschl_vc=73a95f0920aedfa774bd6ccb7a364fe1&pass=1561729065.039-DfMElqA4Sh&jschl_answer=188.8201194935 HTTP/1.1" 302 159
2019-06-28 13:37:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:45 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:45 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.31 (KHTML, like Gecko) Chrome/26.0.1410.64 Safari/537.31
2019-06-28 13:37:47 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:47 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:51 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=f7405f3d9f809b516c34e3a1fcac59864acdc930-1561729067-1800-AWKD182WiBbYN%2B6WJljS4JU%2BXCNzLztXoXH6OcPxj2WzdpLSaAgTUT0MMSsyuXdghoQNwIuawMlHOa2nJO48k4HmfdBpiKgwtkPqceL0gHzPOw8q5MHLF%2FMCAs0qyfM%2F2DbrXneMc41dbLpiRvwB%2FCs%3D&jschl_vc=dfaf3a798fd86591c6244bfc1c0673b5&pass=1561729071.214-U7rYgw40Im&jschl_answer=30.1382710079 HTTP/1.1" 302 159
2019-06-28 13:37:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:51 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:51 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36
2019-06-28 13:37:53 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:37:53 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:37:57 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:37:57 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=0941231f2c13ada21775c76cfe9532638df3bfd0-1561729073-1800-AUz2VDfzZLK6TZijgbDP4twv4bzZNXlpkuUi%2BiuZPtj0O9%2B1Lq95gTsQLdBRInct%2FRlZuV9DAT5c8xxNTuDKCVvOfc1WdP02t%2BenTAjtVukHYJLt7N7v906CwFE%2BnEdxzClNpYR0PVKqOxJbCUl%2BVGM%3D&jschl_vc=c31ceae12737b7f8d3849a7519cbf592&pass=1561729077.416-WXHp5Oa35N&jschl_answer=29.3958205985 HTTP/1.1" 302 159
2019-06-28 13:37:57 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:37:57 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:37:57 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.0.12195 Safari/537.36
2019-06-28 13:38:00 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:00 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:04 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:04 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=e4ad955dd1e709af7e1c15fbeeaea8d27bf280a9-1561729080-1800-AbltC1PZlkVN6PVpmjjeyPLa%2FszGHkWYLS5riXHBC1Hqo1WH0MNDxmdrA%2FNJF0rAqSjX5RkeH0UffNscPwfKYwP1qpPblUO%2BLtlUV2C4QFOwzzZbb4uuqxPM74bb49C2AtslJur%2BiZmhlN6JvXjoaVE%3D&jschl_vc=b9a60ed19314322d3e2287ecfe5b1054&pass=1561729084.471-Y3cWMdnqoX&jschl_answer=18.0540262708 HTTP/1.1" 302 159
2019-06-28 13:38:04 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:04 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:38:04 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36
2019-06-28 13:38:05 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:05 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:09 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=0a8d8de860fec31c1d805a576e5cf7e2d20c8074-1561729085-1800-ARiDu3wUZbhikMYNmvEW%2Fd4seKSSM%2BHLBV%2BAgt8As11QA%2BTxPCAWMnSOvTwkzgavTg6VEflOlGuiaWd%2FJyscVJ%2F2v9eZhib4TEG4YIAeJBkcirSSmhapNKvxE7nnCiAuFsb2%2BP%2Fw%2FXR%2FlBA9r5SizB4%3D&jschl_vc=30fd63b0dd59834ba0b3270cb65c7d03&pass=1561729089.577-x1yFjyZ%2Fpi&jschl_answer=24.8685860979 HTTP/1.1" 302 159
2019-06-28 13:38:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:09 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:09 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36
2019-06-28 13:38:09 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:10 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:14 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=85530b0c28f3ac8e6e3c3b16daf05a444ab1bfc9-1561729090-1800-AUE1iWLXMSE8xIZm7MADqaTqd57nlhyY6J8bE4eegqpBC%2FkWt9uXRwkm1s0D0XqAdxmoTSaAOugw7C9X3DI8%2BZqMYKekma3ZP5HwqvgsWUzJxULdSLEdkZbm4JR83z%2By8yDqd4ShGSqxiJhW1%2FreNlk%3D&jschl_vc=72c5e0d13e9770bf787993f6ea71d601&pass=1561729094.025-xgvJANyGWD&jschl_answer=41.4750327543 HTTP/1.1" 302 159
2019-06-28 13:38:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:14 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:14 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2357.65 Safari/537.36
2019-06-28 13:38:14 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:18 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=d3aa95679f34fd7a9e1757768a3c678d0b70ffce-1561729094-1800-AWJRHP4jbjd7C2K8B72hCNFte7lcfiEuMvh6WZritAepxaNY7d7dcL5sPB8hjeUTg05ll1jZSXUN0AggsB12sqkZRe4Rl2VeWUNBiyfMg0pyQIT5DiUsuTWoFwqE9JJlHWpkwCGs6c9M1N6ifExbU74%3D&jschl_vc=7ccee86e1c104657b0bd90857222ea54&pass=1561729098.842-Cw8h77Bf2%2F&jschl_answer=15.7131187942 HTTP/1.1" 302 159
2019-06-28 13:38:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:18 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:18 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36
2019-06-28 13:38:20 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:20 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:24 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:24 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=4d1130977c3acb5c903653d99ef3bd4ca2c32ce7-1561729100-1800-AWY%2BReBVzmDZVKYn%2BreCJeFAhthwJn%2BgH6GpHPM1Dq9OD%2Bc2P6NrupIXGCm3lu8E%2B5vUB3kyQrrMjHWWsKg6MD%2BvhJ9TejUO1LUdNeR4kq06WDeboQtKQo0ofSrO%2Fy6Hb8p79vDyrwjBoYIhwpRCmkE%3D&jschl_vc=a545f1e0a2dcff2788db5030b6d7245f&pass=1561729104.088-GgWP9yM7Cc&jschl_answer=29.2001813802 HTTP/1.1" 302 159
2019-06-28 13:38:24 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:24 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:24 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.110 Safari/537.36
2019-06-28 13:38:26 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:26 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:30 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:30 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=d55c25e7892b72ad5191c1f1c243f0d616e4c88c-1561729106-1800-AcETQF4r6yKt66kbWhAZdr%2FvEJNXhwozFrzH9ByTMns4gR%2FXl7jzzkCQKUuHNO4DIlQgGNynR%2FUVpUo2m2tKU5dvhLgk4GSWXtWqQOXysvnA%2BKJOtiL%2Bx3L6QvaY1ssIVuljuhEWem1AhfVNjOrrkJ8%3D&jschl_vc=d238b09f4858dfd558cac149d8d3839b&pass=1561729110.353-agWW84ZzYi&jschl_answer=51.8396777015 HTTP/1.1" 302 159
2019-06-28 13:38:30 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:30 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:30 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.11 (KHTML, like Gecko) Chrome/23.0.1271.97 Safari/537.11
2019-06-28 13:38:33 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:33 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:37 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:37 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=39571afb7f5d0198391f207b93b3d03fb6f1d586-1561729113-1800-AeihAC1sUVp3Jg9jzshPYFqd2GaW5GDGJitGpKvcmXil3k7WP%2BEjGRPKRr8kBvmVbH5Gp0ei8WlYAg2ws2KNkWYzmHHI2lx1lb5uy6JyI1fQud81kNsm7A65qBjvPX8w6Vn9HL%2FS27tbp5X0nC37wNY%3D&jschl_vc=b03ddfcc5cac5b4739601ff7af7b3af8&pass=1561729117.537-z7jQIRGMYI&jschl_answer=19.5060681524 HTTP/1.1" 302 159
2019-06-28 13:38:37 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:37 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:37 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.86 Safari/537.36
2019-06-28 13:38:40 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:40 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:44 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=c72235c969a9d46eec52cea0999895a72fd2b5fe-1561729120-1800-AT9W1KPq8hNfprO8rHjj6EyT3Tv7NlytGjoxwjpG6FHX4rm7%2Frx9WmTIXxiNikRvGl8mqvLCTYJp53S4CREm1GnojU%2FgLyXu96rG59o2HQBxv5qlrLfaCSymnuqjvmiuwLLmKP2a6SkO66U0OMYgdGA%3D&jschl_vc=f94e26858d5f8852d8a93fae89e49e48&pass=1561729124.961-orha5yY778&jschl_answer=23.9667435944 HTTP/1.1" 302 159
2019-06-28 13:38:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:45 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:45 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.112 Safari/537.36
2019-06-28 13:38:48 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:48 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:52 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:52 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=4f52f5b512279547b942ed06436a8838c16d20da-1561729128-1800-AXN8zhDFCYKWZN%2FdMP9waTzMsaUBL1qbrWFHBitTbt%2F1E2hcXQzCY%2B2%2F6Dmd4S%2B8ZxNxqbAwl2eOX%2FsMHZnbKeZTb5kHiB3a7fVg9U3w8%2BOM5mmLkqGbSOViwr2%2FsQeX67zv0CLy9hB9ozdsDU4CJTo%3D&jschl_vc=265ce4ffd8afa6382595ac56d81f2f8a&pass=1561729132.438-XgJMQPIWv5&jschl_answer=53.3341269374 HTTP/1.1" 302 159
2019-06-28 13:38:52 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:52 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:52 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.139 Safari/537.36
2019-06-28 13:38:52 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:52 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:38:56 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:38:56 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=5fe6908bbfef3b5491a9546f1b8bcb5c22ce9784-1561729132-1800-AQyvkyYXi0rcZKVIVYF2xsW0SuRw51zqMGxvdVqtqGXnh6P0L2koAdHyYO6doHLpKKR%2F%2Fv%2BCekbgqDfuCGei4%2FZR1UjWC1uZO7flYvzkT9aDPxHoooH7wgK%2BP%2FDE8EIFTP%2FwNoWM8D%2FGxYfO48MWc5c%3D&jschl_vc=4d5f441870d98d2006691ba80dac9ead&pass=1561729136.748-FP%2FcNr96fn&jschl_answer=37.6343702531 HTTP/1.1" 302 159
2019-06-28 13:38:56 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:38:56 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:38:56 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.103 Safari/537.36
2019-06-28 13:38:59 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:38:59 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:03 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:03 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=9505af6aac3aa099774b95d6e04dce7371710f9b-1561729139-1800-AUYpQqAah9dlID8yIQCuM5noAgOpRIn7QhxvDceuDpFmIYInAP1Egn%2FdJhRSXZRa6MXHDDRnvDHUYNVKYLSTXR4tRf0y3pgdxFPJnSR%2BZqU2wNI8bawzVneav0XfJ40NXSo2kAZjerd2DLILX02fgho%3D&jschl_vc=d1b3192e45a8b003eb6b65522a611e9b&pass=1561729143.1-fS2viqMXIX&jschl_answer=32.1527426317 HTTP/1.1" 302 159
2019-06-28 13:39:03 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:03 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:03 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.143 Safari/537.36
2019-06-28 13:39:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:39:06 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:06 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:10 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:10 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=1d7df4f3a92e6bc3e9558f26f7ac6d32c1f8eaeb-1561729146-1800-AbU05c2P8jgZ5c0Ud4OJh7fVEthVja7alI7vajIRrTSm56HSN3TbdqhymVoYR9wzrxOhHXja%2ByRuc4gmK9CZf0Rsd668ZGTT%2FRz1H453KPIYEbgPTHMTv9BCRyRhPdvu%2F9EsGiWcXIugAADmbajIIAQ%3D&jschl_vc=3a7a50fc61033a18799a3f276a0aa801&pass=1561729150.373-zRm1Gu15ny&jschl_answer=58.0302679040 HTTP/1.1" 302 159
2019-06-28 13:39:10 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:14 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=82285f46479a81271b492bd5fb468a4a9e065132-1561729150-1800-Ac2POVqZe%2FP3TwSf1ZZKWomxDfc%2Fydcn6GPqnei2hmia5qZhOlgF2eNIW1chcUmaJYLz1jpzJDQMd0gY3Fnm68p2fDNb2Ed5LGVP5H9C%2F0hw2HKsBXbUsk44nK8UfMFjsK3iGOVXkgQxR9vBGlIyqDo%3D&jschl_vc=5d3a02b619edd84a133822a12cf55e81&pass=1561729154.464-quhg9mPxLx&jschl_answer=10.5693723306 HTTP/1.1" 302 159
2019-06-28 13:39:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:14 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:14 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.94 Safari/537.36
2019-06-28 13:39:14 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:14 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:18 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=e3d9250d763a6a0053f7f0d601ab4bbe23c27ec9-1561729154-1800-AWU6C08GThQWcMR3gDvL90I6gIBqAVQlk98wdU6pUuiRwnQmZCk8Xu29Js0h2v8nK9nY%2BVc6UuSnbuTitwvD%2Bd1c9gU2nWfMRW%2BbrndZjNnUE6mZeF55MP5F45cNlvWKVv1R0zTW4HkpM7hZwSAu9Hs%3D&jschl_vc=cb2fc430b1d41bac9479ddc20d6195f9&pass=1561729158.747-%2F%2Fd%2B9ayaz6&jschl_answer=38.7679011102 HTTP/1.1" 302 159
2019-06-28 13:39:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:18 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:18 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.71 Safari/537.36
2019-06-28 13:39:22 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:22 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:26 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:26 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=88bb21e92ecbae758ab0c18379dc2745f88f48ae-1561729162-1800-Afl9P4Ih9mdOvlY2S%2BErgeWQlbyx5E94vTHheFsF%2FAl6kzw5LLZnv83%2Bfrtk2N49OwPJ3Dnsp0c5YQ1EpT0r6W%2FBxwnRX4JRQ9gNsKPoqEpLcmXclsvbCJCtIDBqLck%2Fow2wRdMj5VphPxJO8VJS9MI%3D&jschl_vc=742fb69892d3bf82b7f5168c485a1168&pass=1561729166.177-d8BYMTg3we&jschl_answer=41.1061949959 HTTP/1.1" 302 159
2019-06-28 13:39:26 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:26 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:26 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.91 Safari/537.36
2019-06-28 13:39:28 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:28 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:32 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:32 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=dae24463608a20fa5b7de7495e1e8b1dcbf3d8eb-1561729168-1800-Aal74RkXTv89dP26sNAqKDg0u5X0Zm4IIzUgoi%2BqhyiO7P0m%2BmveaYstJqNOwU3e20zlC9eoz24mSKsOq%2FyqCjd%2FgnGokq92bCRkqLfEw3XdRwvZSL4nLtxcVr3YvRyzenP8h134dErz8Ya0yfn9Dfk%3D&jschl_vc=617329c71f418a5c7528211dfea4c18a&pass=1561729172.585-QC6rev41wr&jschl_answer=18.5342281630 HTTP/1.1" 302 159
2019-06-28 13:39:32 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:36 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=c7fbe45ce276aa383ff4b0f30911944da0612ae4-1561729172-1800-AeYlPkX64mrsbkrCs6E53LajMiVWtPR4wVm5T1XXP0QYEhzaqNizNqvYkYgyZOcpX%2Falb3yP%2Ffyoghcdf97%2BAOWCNbJ83C5AjI2uYxxdtreRQnxBnHPBS8YvjI3Q3M4SN550hgH4bfVob59wBViQiOc%3D&jschl_vc=726483d06964629794b303f6d1450c62&pass=1561729176.69-qrWr8FCN5X&jschl_answer=4.4081463849 HTTP/1.1" 302 159
2019-06-28 13:39:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:36 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:36 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.116 Safari/537.36
2019-06-28 13:39:36 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:40 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=37cf692b516d4a5f7432f01a5d315c0b66341758-1561729176-1800-AVgFQgc378RcDbwrW8akmVl53nitAUB30MZDqcfXSBVfOY3kQiM237dglhk9fxtrSFOf4NH0yPFQ7vtYq5pe2RylvTnCTEqN0DA0YkYjmaRMKBpoaq5l5OKivP5kvGqY3ISMMdSQGesmBwbXW7PIpqs%3D&jschl_vc=ae84e50399fcbe5f9c34bce2945754ca&pass=1561729180.963-gcl69Tz71M&jschl_answer=25.9572898431 HTTP/1.1" 302 159
2019-06-28 13:39:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:41 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:41 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.181 Safari/537.36
2019-06-28 13:39:43 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:44 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:48 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:48 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=72b327cdeaa46a4d13fc8bde8e5b82d612a17786-1561729184-1800-AWmvfWtMESH%2BxAkWI6r5i26sSvGDb1UaCxmLHIS75jn2oyCscTbnAwQktO%2Fb6k1l1TWI36qPetpOuzDDvB94q%2FFtbkc9goBjUrqj8Q%2BkFt0jTAUssie5hZmTgmcXlOZnlgb59qLxHoOGZ2KAl8Uyg%2Bs%3D&jschl_vc=ce4739e70cefee0cc5214fbe67d6530c&pass=1561729188.035-u8GzCbDiqB&jschl_answer=20.0457175425 HTTP/1.1" 302 159
2019-06-28 13:39:48 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:48 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:48 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.94 Safari/537.36
2019-06-28 13:39:50 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:50 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:39:54 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:39:54 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=ca94dfd9b5e2b100975194437c943886976bf4e4-1561729190-1800-ATIrxX8li26q8zeCeV9kd3eC%2BXBAIkW0SMlTO%2BCigbO%2FwJUoym9YtNXlNo%2Fw0DFlikgMvlfBAhCpDFCw3G4XpyfTP6wu49rwHd6o5SKNac1eHO2O5JhjDaSPy9KXrnvUTCJ5o0wUZF%2BxIuGIL9To60c%3D&jschl_vc=74568c860606c75fe4f09992703163a9&pass=1561729194.366-BhRHSD9OFL&jschl_answer=37.3964025711 HTTP/1.1" 302 159
2019-06-28 13:39:54 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:39:54 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:39:54 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.110 Safari/537.36
2019-06-28 13:39:57 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:39:57 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:01 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:01 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=f04e1a951e62340cff3d28edfe122c0d40dc8b95-1561729197-1800-AUZwOGyVh9zxe298%2Bv5kTMOAoxHKN%2F%2FQBWleQmBPTViFcNhmxV9S4FXKg4afkmqF3a%2B3ScyGsgxoTULWdd%2Fe7X5LuZSYdqAUxH4M8OEEx%2Btlc3aMX%2BQwLEmeeBTMDOwJMBvFBj7MdPvMEfYzPpycLow%3D&jschl_vc=2dfa98ca32efaa162ba96d530dfeb67e&pass=1561729201.143-8ZKqFURBd8&jschl_answer=13.1052997179 HTTP/1.1" 302 159
2019-06-28 13:40:01 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:01 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:01 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.89 Safari/537.36
2019-06-28 13:40:02 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:02 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:06 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:06 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=2bcdf5c25f0ffb2dc90d39b60fd1b85299a24c55-1561729202-1800-ASVWmd0Kj0mxUtyujJf2Ay9ZnVa7lkDOCIjRfJZUjvmUi5Pya1E3FDCVyvzo%2F7q9NG1AtGUikbHFSv0Ob7IsZR3o05yd%2F5cEc%2FqpVw1vGlrnBXTiaYtomwEn0O%2FgludY5ZIOajqVqjBM5Cvr0UeBt9E%3D&jschl_vc=0287f028ff67aaaea71f01ab45cc52d4&pass=1561729206.393-WvhTQZkcI6&jschl_answer=16.8363210122 HTTP/1.1" 302 159
2019-06-28 13:40:06 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:06 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:40:06 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 5.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.90 Safari/537.36
2019-06-28 13:40:07 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:07 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:11 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=8694ecf7d810e6167627a4597f45630dd777ef31-1561729207-1800-AZfSVLqQU713%2FvO9tiVaCZ4bxwPqJotcYKCpSRE80ZDhABXgulLpD70i5qJTcZx5AzN7ssZpc9eIHECzzUklfnpE9mXEaBGcRwjj5lzkTnJNsWPWShSl6%2BYmMb99psYMCduyzcyh2j6kKu%2B5U6KeQjc%3D&jschl_vc=d6684ae94556f82529e8063c40f5de09&pass=1561729211.492-bqhhru0zXL&jschl_answer=13.2709801839 HTTP/1.1" 302 159
2019-06-28 13:40:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:11 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:11 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.96 Safari/537.36
2019-06-28 13:40:12 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:12 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:16 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:16 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=82890c8a8c20b58260b8b72199be47acd9bfdbed-1561729212-1800-AZS8MvT%2B5gE7Qc7DT9XJ8JNtwyS1GMbBapdhGKirW9yn0jbbFpG8lFjSsGIUwDhB5LaiNUeOTolFbta7MKQF3wvcdlFcHKSbc%2Fr624Zn4uwsQZPzVxV69FPyzoXyNUdKFmw5Q5%2FHCps0BaVk8jijz0Y%3D&jschl_vc=b46250cc74d9b0bf88bb2cba17d1799b&pass=1561729216.262-GPH78zpVCG&jschl_answer=20.3275264959 HTTP/1.1" 302 159
2019-06-28 13:40:16 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:16 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:16 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.22 (KHTML, like Gecko) Chrome/25.0.1364.152 Safari/537.22
2019-06-28 13:40:18 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:19 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:23 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:23 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=59f926244111f6bbc2f9bb1c41a762a05270bad0-1561729219-1800-AWsAd7AldQEb0SR0sN%2BNtv820gbpeNS1C%2F9I8nStRQGVB02TY5Ubt8C9WHIw34eCeAl%2BSlbWxfbfBKQSNx%2Fo7u7tqAhtoYYtwI0%2Bqaotl5Nlr1JoN3J3Ttmlw8kUtiTyGEkDoHskWtt%2B4vw5IzxxARw%3D&jschl_vc=34d2f47a8cc7e391334282e62c330abf&pass=1561729223.033-nd9lpv%2BqRP&jschl_answer=18.1314069441 HTTP/1.1" 302 159
2019-06-28 13:40:23 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:23 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:23 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36
2019-06-28 13:40:25 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:25 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:29 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:29 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=d79c79a0fc26283a61ad54760fd5abba45e65813-1561729225-1800-AQe%2F1OQpo%2BKizm2WETQbZcEY8uIumGkrUCqpWXdQH4umKPqHZRHaNePnf5bBej%2BByF7E1bYIjdCQRGEym2l4UybqsHaUijb4PmFvVSO0dCIRTVjuQJ0eoIbz%2BYmaztDoFSpkcLBvRCf4CELpCAfY11c%3D&jschl_vc=cbfc1e06e4da01421f1478c1ea4fe526&pass=1561729229.214-QyuBpV2sW8&jschl_answer=49.5715499069 HTTP/1.1" 302 159
2019-06-28 13:40:29 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:29 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:29 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.62 Safari/537.36
2019-06-28 13:40:32 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:32 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:36 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=646ec89dc3254d92e4f0b6720975b97234a51a49-1561729232-1800-AV6Uaf%2FK1xTet1oB7PN%2Bw%2FjsBJliJDF2QQk31EPkMXhEmYXvMPe%2FQief1O8bUauw8RAx2HTwEYxFKFSudEdqrEQ8YHQhZSFTN3s4Jch%2FxOnESqb9jwn5TZTWZww%2ByWRtcqqm19glGwIj2a6tsTrkohM%3D&jschl_vc=844e0c03165e7234f27a2a0eff42d709&pass=1561729236.658-qtLuMvQXVq&jschl_answer=31.3028518276 HTTP/1.1" 302 159
2019-06-28 13:40:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:36 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:36 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.103 Safari/537.36
2019-06-28 13:40:38 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:38 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:42 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:42 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=0909e7dbe565e20779c295ff08f09ce33036585a-1561729238-1800-ARJ2t4KsqhLf7MB5Dw8DQWyRkTqM8TuJKDvnF7rpx0q9RiGlYFUBmAGxZWN8qBT98EbuUUceOhyreQ6rwK3Njdgzmts8crMScUbOko6gv6bb0lYJxYMtp5SGHQaSxabvyD5x8lpZH9q1s8FVxTaNx68%3D&jschl_vc=adcf3e02624085a0c79307555603c65e&pass=1561729242.77-kNe7%2BFKDDb&jschl_answer=17.7843064899 HTTP/1.1" 302 159
2019-06-28 13:40:42 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:42 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:42 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.94 Safari/537.36
2019-06-28 13:40:44 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:44 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:48 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:49 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=f13321f481f41ec36dea9db894c42f204936a9cb-1561729244-1800-AenBAUhYSzjfRjXLbwv2t%2FbqJroRnVTRSmgbma0KH1xcaazvHhtLBxaEEzHuAZeD6AG%2BLecXg6SiVCR7quWQr1fRzEmKVpPg6NaC8LvqJ3hPierATrzPS8e0xtzL73QrzTzgFvj%2FGl0QDfIjNyxOng8%3D&jschl_vc=53b4b2f23bf6cc74e2274342f756cf54&pass=1561729248.931-SJ80wLJgnX&jschl_answer=37.3156887326 HTTP/1.1" 302 159
2019-06-28 13:40:49 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:49 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:49 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 5.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36
2019-06-28 13:40:51 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:40:55 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:40:55 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=4c7ba593c84f8afa9abd1867eb98cc11357f5f54-1561729251-1800-AQjq4kbuYN%2Fo0yJbp0h%2FybS%2BzJ97KDyU4IRlqfXUaRDqlyDoMqAXO0t17kS4VvXcp%2Fk%2BHyesoHgvIPGeNhw9LP1zc%2FLDAf%2BhSGRePtUEicq8vBnnBJ6xeYbfjgk6%2FzW8k3zHKkxROjW8bzom%2BrLAMEg%3D&jschl_vc=6f56330ee9d0e2a02bee026b08da4b6d&pass=1561729255.706-EfAdnBeW0p&jschl_answer=60.0356755982 HTTP/1.1" 302 159
2019-06-28 13:40:55 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:40:55 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:40:55 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36
2019-06-28 13:40:58 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:40:58 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:02 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:02 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=73b98fda08e7e8e9d8a8926d9fbfbfd4f6c3d699-1561729258-1800-ASIr9D2jYRxIX%2BA6Q0TGc2TbqxsE%2FGJd10AemU9lxfs875MzO4p2%2FvuBrvxo76CKmpj%2FuIOgW9RBAodFPfgtMSUfXMlYXKVbVnJmWKI%2FJLW%2FB2FFVabLc77N7%2B94Cw%2FGiiGCn1q7UK01jYgYUor%2Fwak%3D&jschl_vc=1bc17789bd66580b30b820d06c2cc480&pass=1561729262.28-ZbvcxZUu46&jschl_answer=9.5416749038 HTTP/1.1" 302 159
2019-06-28 13:41:02 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:02 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:02 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36
2019-06-28 13:41:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-06-28 13:41:05 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:05 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:09 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=02852b17021b0517108ab07f6954dc9c1cc1302f-1561729265-1800-AYa7q%2FozsGs9sFfI0pAJMPak3OXlXn48cAe%2BGPLnoshr71Xt4fGRoijUWBITvnaCJ%2FLqMiwcvDMMoAkPQk2EsjP1WdywYVXOshi7bIsygKOf72GCm7uj9GeM63bYA8YmaOn5CumAU5fj1enUip%2FeST0%3D&jschl_vc=f8babecb55200d7ff7453be5c2aa7190&pass=1561729269.791-mnmBe8GFWO&jschl_answer=76.9595640044 HTTP/1.1" 302 159
2019-06-28 13:41:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:09 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:10 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.75 Safari/537.36
2019-06-28 13:41:11 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:15 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:15 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=59464d590d27d58164e5bee3f709f111f1b1b036-1561729271-1800-AftDsHCoT8caNMUDTGvRg8UScSYyi5%2FxCZ9cgHtwAlkAnDURn5C8j0px5SQ7V%2FlhgqlkDm1OeXlCvP57KGUVUHBPsMeClWiCA6yoPOZhk2T9qrTOClXUST4viipmfjlPbik%2F7M5bu%2F%2FPt2cQfRVOtNw%3D&jschl_vc=26280c6f1e795d1a9cd68d99dfaccb39&pass=1561729275.107-8o57iK%2BMXk&jschl_answer=31.0425280168 HTTP/1.1" 302 159
2019-06-28 13:41:15 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:15 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:15 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.99 Safari/537.36
2019-06-28 13:41:17 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:17 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:21 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:21 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=2000359e4ee2ca0069e4ea4c6713dc346738472f-1561729277-1800-AS0QXSdrossSz%2B2V9HQnrkJ2sUnxDClKkMrBFxFX4mpL7gcAIR9Vz5%2Bsc3%2BZWUq%2FEOVrd6Y%2FB6T8AFdLFj7T0ypke4FB0Uv9DPDEmt4N160ElzVMsahCo7axoPiiFbDWeHbav7AW%2FTI5GiU80gkRz%2Bs%3D&jschl_vc=f1e546368f79dca4346b6b29877b0c6a&pass=1561729281.186-agsB8l63Uq&jschl_answer=16.5196798413 HTTP/1.1" 302 159
2019-06-28 13:41:21 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:21 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:21 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.62 Safari/537.36
2019-06-28 13:41:23 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:23 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:27 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:27 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=025247b886b153e7a4f07e14461f49ee426492d5-1561729283-1800-AZ8FSdnbblwZROtv2%2BXW5ThVaPcHxdGkUzaHQIMiDHDgjs8h%2B7eq6eu9TWj2XHBl1TNt%2B7v2bkkXua1QYNJS9WJqLOpL2vlra85M6kdxCA2P0kXmt10KFC7r9RdPyHKhAf6Olm7%2Fo4w%2Fzfta1HfvTRs%3D&jschl_vc=899e17cb5d4143898412664f091ad16f&pass=1561729287.88-T%2BIxxUJKBa&jschl_answer=18.4756087604 HTTP/1.1" 302 159
2019-06-28 13:41:28 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:28 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:28 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 5.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.63 Safari/537.36
2019-06-28 13:41:30 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:30 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:34 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:34 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=a8bfda20cdf8e8f7fd2c95e81d81f8e3c05751ab-1561729290-1800-AfayeleOweHYaey52aZ0w18daK%2BhktIIsBCavnYp%2FLXm5iGpuO4Xs5mzukG7ULD68jcN5XvC39YpLN3srfw5CkmbXGa4a9N5IZfit%2F9igEBw09J1hSzzDq6ikRv99deUfOhqkva%2BiFe5fsl367xIF14%3D&jschl_vc=9932990675ce85df2f49517a21d91f1e&pass=1561729294.575-pEk%2BeGdOit&jschl_answer=27.3765760581 HTTP/1.1" 302 159
2019-06-28 13:41:34 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:34 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:34 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36
2019-06-28 13:41:36 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:40 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=2b42b688df31a4464e30058674d96086674022c7-1561729296-1800-ATSfn%2FBigdW77E0VhGg2EJ%2B8VtZE05y%2B3bsLTqMdhw47gr5WluOwCtAaoUWUoZMx6hFezE%2BQs9rD8Y%2B%2Bol2KidDHPL9F2zTOcsLj3jc08uhsg%2BT7eOber6KzQvq0Zpk0dpoHlnk8FqEFQ8YwUojd0ok%3D&jschl_vc=bcf871de13fe02801cf27d29cd5b8848&pass=1561729300.974-fY62gxCThz&jschl_answer=20.6013785563 HTTP/1.1" 302 159
2019-06-28 13:41:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:41 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:41 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.99 Safari/537.36
2019-06-28 13:41:41 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:45 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:45 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=3e57aec0cd1f1ddcb250663a6ec05c0deced50e6-1561729301-1800-AQqDS6i0lv%2BBYGR4%2B4nuj%2FGVk2SZ4mEfpRn0hbQQarDSoLzXwWViSzTFp%2F%2Bqx%2FuDpe73o54hz0wzSpw%2FBlrTrYYtO8pIw3yPOQha0kVOysxGKd%2FqMTWtdr9cBFSMVS97qLgH3CAYMDVKfdKjNEewVFI%3D&jschl_vc=30566b9f203f9a6c65eb49a5b7f54722&pass=1561729305.914-bGkdxvWn%2B4&jschl_answer=24.1839541908 HTTP/1.1" 302 159
2019-06-28 13:41:46 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:46 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:46 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.99 Safari/537.36
2019-06-28 13:41:47 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:47 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:51 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=66332a1704ddc03c2271dd78902b42b3857a3b3e-1561729307-1800-ARhOgilvkrAc9aGMwXw2dLHOgzadGtWh8a80zMmZgLkxBu2cq1HG1fpqhHiaDZY%2FtEyyxmMLLOKLg1sQ154pDvQSjz62fh46JQzAQwE3dJI7g0iAYbK49P%2BmfLhIJEWpkclp%2FQG9iBlA%2Fl7rylauJZ4%3D&jschl_vc=d7d423e24e2851817ee139456884186d&pass=1561729311.813-h6ZmIcCJi%2B&jschl_answer=53.7055097650 HTTP/1.1" 302 159
2019-06-28 13:41:51 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-06-28 13:41:55 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-06-28 13:41:55 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=b9c6787b1e0966b79b0332e73ce2ae5e164d9276-1561729311-1800-AaZJpX77%2FGKKimr7JjIPddIWwA21W5srkSwfQMJ6DE%2FZ9qOOEERhnGzV30mFF9jOeqo6Ihwd7gnU7berE5okJgxNGiFtqBKczKmHZ%2Fu84Hlbz0k5LR7dvjKyMcYfthu2nL3Gpr5UiWlh15pVSgodReQ%3D&jschl_vc=18db7eb797e7795bec40a1f4a3e86191&pass=1561729315.905-7HGwfAHbfD&jschl_answer=15.7170149449 HTTP/1.1" 302 159
2019-06-28 13:41:56 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-06-28 13:41:56 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-06-28 13:41:56 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.79 Safari/537.36
2019-06-28 13:41:56 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-06-28 13:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-06-28 13:41:56 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None

Jun 28 '19 13:06 guillaumedsde

@guillaumedsde Will need to investigate this further, but it might be related to your COOKIES_ENABLED=False in your settings. For the middleware to work, you need to activate the cookies: https://github.com/clemfromspace/scrapy-cloudflare-middleware/blob/master/scrapy_cloudflare_middleware/middlewares.py#L45

Jun 29 '19 11:06 clemfromspace

Hi, with COOKIES_ENABLED=True the issue persists:

2019-07-01 13:28:51 [scrapy.utils.log] INFO: Scrapy 1.6.0 started (bot: crawler)
2019-07-01 13:28:51 [scrapy.utils.log] INFO: Versions: lxml 4.3.4.0, libxml2 2.9.9, cssselect 1.0.3, parsel 1.5.1, w3lib 1.20.0, Twisted 19.2.1, Python 3.7.3 (default, May 11 2019, 02:00:41) - [GCC 8.3.0], pyOpenSSL 19.0.0 (OpenSSL 1.1.1b  26 Feb 2019), cryptography 2.7, Platform Linux-5.1.15-arch1-1-ARCH-x86_64-with
2019-07-01 13:28:51 [scrapy.crawler] INFO: Overridden settings: {'AJAXCRAWL_ENABLED': True, 'AUTOTHROTTLE_ENABLED': True, 'AUTOTHROTTLE_MAX_DELAY': 10, 'AUTOTHROTTLE_TARGET_CONCURRENCY': 15.0, 'BOT_NAME': 'crawler', 'CONCURRENT_REQUESTS': 100, 'CONCURRENT_REQUESTS_PER_IP': 30, 'DEPTH_LIMIT': 2, 'DEPTH_PRIORITY': 1, 'DOWNLOAD_TIMEOUT': 20, 'LOG_FILE': 'logs/default/recursive_spider/29946c689c0411e9bb2954e1ad4c5f56.log', 'NEWSPIDER_MODULE': 'crawler.spiders', 'REACTOR_THREADPOOL_MAXSIZE': 30, 'REDIRECT_MAX_TIMES': 10, 'RETRY_ENABLED': False, 'SCHEDULER_DISK_QUEUE': 'scrapy.squeues.PickleFifoDiskQueue', 'SCHEDULER_MEMORY_QUEUE': 'scrapy.squeues.FifoMemoryQueue', 'SPIDER_MODULES': ['crawler.spiders'], 'TELNETCONSOLE_ENABLED': False}
2019-07-01 13:28:51 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.throttle.AutoThrottle']
2019-07-01 13:28:51 [recursive_spider] DEBUG: RecursiveSpider's start url was overridden with https://www.torrentday.com/
2019-07-01 13:28:52 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Android
2019-07-01 13:28:52 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:52 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:52 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV13, Brand: Sony, Model: BDV13
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Nintendo DSi, Brand: Nintendo, Model: DSi
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV14, Brand: Sony, Model: BDV14
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: LG Web0S SmartTV, Brand: LG, Model: Web0S SmartTV
2019-07-01 13:28:53 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Sony BDV11, Brand: Sony, Model: BDV11
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:54 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Nintendo DSi, Brand: Nintendo, Model: DSi
2019-07-01 13:28:55 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:55 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:55 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Applebot
2019-07-01 13:28:55 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:55 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Applebot
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Other
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: SMTBot
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:56 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: WebKit Nightly
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: PhantomJS
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Robot
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedDeviceType] Family: Other, Brand: None, Model: None
2019-07-01 13:28:57 [scrapy_user_agents.user_agent_picker] WARNING: [UnsupportedBrowserType] Family: Zune
2019-07-01 13:28:57 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy_cloudflare_middleware.middlewares.CloudFlareMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy_user_agents.middlewares.RandomUserAgentMiddleware',
 'scrapy.downloadermiddlewares.ajaxcrawl.AjaxCrawlMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2019-07-01 13:28:57 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawler.middlewares.StartRequestsMiddleware',
 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware']
2019-07-01 13:28:57 [scrapy.middleware] INFO: Enabled item pipelines:
['crawler.pipelines.scrapy_mongodb.MongoDBPipeline']
2019-07-01 13:28:57 [scrapy.core.engine] INFO: Spider opened
2019-07-01 13:28:57 [scrapy-mongodb-pipeline] INFO: Connected to MongoDB mongodb://user:[email protected]:27017, using "scrapy"
2019-07-01 13:28:57 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2019-07-01 13:28:57 [recursive_spider] INFO: Spider opened: recursive_spider
2019-07-01 13:28:57 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.59 Safari/537.36
2019-07-01 13:28:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://www.torrentday.com/login.php> from <GET https://www.torrentday.com/>
2019-07-01 13:28:57 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
2019-07-01 13:29:04 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:04 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:08 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=defe609459a99d94b2b73ecc0cc9681c2b92eec4-1561987744-1800-ASeJ6sY5UrDWCJVHGDwv54soYNyci84VCA5XsvoG5UCNoDoRffjgqcKmlPeD0NXQPyZQLIpqPno7gUdYBn6QoM9WGuVD7oUzMhVyrn3fHTrqZROB%2B11S8zgzeEPh%2FFQZKGcppnHQre50DaaopVAYaxg%3D&jschl_vc=6b0e367810fd325219eb35428bd84cfe&pass=1561987748.932-jDOSdOsxGw&jschl_answer=31.6275217492 HTTP/1.1" 302 159
2019-07-01 13:29:09 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:09 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:09 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.86 Safari/537.36
2019-07-01 13:29:11 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:11 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:15 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:15 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=11ae571e886b62bac46356fa56e35ce08f72affd-1561987751-1800-AZbcx%2FSfRhRzESpA8xPc5h3OawiOUHSii%2FY5van%2FNMeFfhJq5aWqvD%2BxpdJoRO%2BG9l6%2FU6ESli4OyiPi3woDcamXYGB8AqVC6bPgngiGXGH9R7HYCaOpBjxKQouIVoVH6xKrWvdflOw2qaEJ45ph%2FgA%3D&jschl_vc=e62cfd15f0322698e99f5aca3b221611&pass=1561987755.696-cOXdMYHJpC&jschl_answer=22.0756028387 HTTP/1.1" 302 159
2019-07-01 13:29:15 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:15 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:15 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36
2019-07-01 13:29:18 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:18 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:22 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:23 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=06a7e6490ffd6481e1d6bf3990c26fed4b723aa6-1561987758-1800-AXLkIwEwigFE7pSsx2%2Bt4Gc2srZgmjlKgL40%2Bmne79a%2B%2FD%2F%2FsMWqz83y1n%2BjI5M105skjKa3dHb0SsNQvCTO%2FLSnTuztEY8MxKvs21ehCeUJT2CshtP%2Fnbc6%2Fr6bPfaQ4tbtxEgDocESpqujdTEs2TQ%3D&jschl_vc=2c0312cbe6829342de05ef29db34dfc8&pass=1561987762.938-HKs9pWTVAg&jschl_answer=17.4684630839 HTTP/1.1" 302 159
2019-07-01 13:29:23 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:23 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:23 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
2019-07-01 13:29:25 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:25 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:29 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:29 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=260cde113faeb5e99f1bcef4100108e92741c026-1561987765-1800-AYDOFVB1larxHhFhYmuw3EWcUxiZe13u8Nn2iqmv9w4h%2B99qww3WOiXByyA88ffaIlkL9dcoa%2Bs2MzgljtZrhvmFMzaew%2BqYaCqzuEM9VvyMnOTMKrCTbCiSLXPv9lsjyBJLW9r59G1kqniFkQ2unlQ%3D&jschl_vc=7a0c06d4c9d7cb8d2947cbc1fa0dc642&pass=1561987769.675-U4EG9r5%2FRG&jschl_answer=96.8751686634 HTTP/1.1" 302 159
2019-07-01 13:29:29 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:29 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:29 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.116 Safari/537.36
2019-07-01 13:29:32 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:32 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:36 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=ae8b616be9fb44d972564794560367f32a72f1e8-1561987772-1800-AcfdiuaftuAr8G5RQpvxsgxrP61yd9s7NtBLNq9HnQza0EwJdD04e3uJveHl12AvqBQ9D0J%2FDLnZUxXQT%2BQzEqZqZWldAkgJdLt3%2FABzVo8GzYLNBJysuzqskpEzb773kxAYW5CtcdgU1%2BzfmhMOKtI%3D&jschl_vc=a4bf829fb98595d749698f21b71c5271&pass=1561987776.643-s6K8uIzFvH&jschl_answer=24.3652839584 HTTP/1.1" 302 159
2019-07-01 13:29:36 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:36 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:36 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.75 Safari/537.36
2019-07-01 13:29:37 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:37 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:41 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com
2019-07-01 13:29:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /cdn-cgi/l/chk_jschl?s=7259f5338dc2dd8252234d8cc5a3cd9ad993cd5d-1561987777-1800-AbRRJMcE1GCRHeqUxZXivC7NgovldtEMjIS7NhBOvSNpIC4wBNdE3f5d%2B1N%2FFvjFmQCDUNfbU0DtZoEosodYK%2BjcjIkpXgBe%2B9bk7Bo%2BYHar4ul%2BwNxAyXm1cix7wdJUKHoO%2BmpCLb2j12oCEd1lnsQ%3D&jschl_vc=cb9752f8398cb38d3a1d65dc09167dba&pass=1561987781.623-XMmJRowbYz&jschl_answer=28.3313622992 HTTP/1.1" 302 159
2019-07-01 13:29:41 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 200 None
2019-07-01 13:29:41 [cloudflaremiddleware] DEBUG: Successfully bypassed the protection for https://www.torrentday.com/login.php, re-scheduling the request
2019-07-01 13:29:41 [scrapy_user_agents.middlewares] DEBUG: Assigned User-Agent Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.81 Safari/537.36
2019-07-01 13:29:42 [cloudflaremiddleware] DEBUG: Cloudflare protection detected on https://www.torrentday.com/login.php, trying to bypass...
2019-07-01 13:29:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): www.torrentday.com:443
2019-07-01 13:29:42 [urllib3.connectionpool] DEBUG: https://www.torrentday.com:443 "GET /login.php HTTP/1.1" 503 None
2019-07-01 13:29:46 [urllib3.connectionpool] DEBUG: Resetting dropped connection: www.torrentday.com

Jul 01 '19 13:07 guillaumedsde

Hi, I am experiencing the same exact issue with cookies enabled when trying to scrape a site behind cloudflare. Has anyone found a fix yet?

Jul 24 '19 21:07 vgarleanu

scrapy-cloudflare-middleware scrapy-cloudflare-middleware copied to clipboard

cloudflare challenge 503 continue to occur after solving the first one

scrapy-cloudflare-middleware
scrapy-cloudflare-middleware copied to clipboard