fivedays555

Not a problem. Glad I can help. Let me know if you need any more information.

I tried the following attempt. Should be working: ``` url='https://www.iafd.com/shopclick.asp?sku=9344975' response = get_scraper_request(url) res = html.fromstring(response.text) res.xpath('//*[@class="title"]')[0].text >>> 'Fire Watch 2' ``` I think the direct request would fail is...

Should be. Otherwise, you won't be able to scrape IAFD.

No Problem. I will put the function call below. ``` import cloudscraper scraper = cloudscraper.create_scraper() def get_scraper_request(url, **kwargs): logging.info("Requesting: " + url) headers = kwargs.pop('headers', {}) cookies = kwargs.pop('cookies', {})...

Glad I can help. Cheers!

Not sure what you need. But IAFD has a very sensitive request rate limit. To be safe, I put delay for each IAFD request as `time.sleep(randint(100, 200)/10)` And all IAFD...

Oh, I did not realize it was for Adult Film Database. I never touch or use the Adult Film Database agent, so I don't really know... Mostly, I am using...