cloudflare-scrape
cloudflare-scrape copied to clipboard
Why doesn't cfscrape work in scrapy
trafficstars
My code is as follows,but it returns 403
def start_requests(self):
user_agent = self.settings['USER_AGENT']
for url in self.start_urls:
tokens, agent = cfscrape.get_tokens(url, user_agent)
yield scrapy.Request(url=url,
cookies={'__cfduid': tokens['__cfduid']},
headers={'User-Agent': agent})