crawlera-tools icon indicating copy to clipboard operation
crawlera-tools copied to clipboard

Published 20 hours ago • verified publisher icon scrapinghub

Getting 500 and 503 with crawlera enabled

Open Waqar-ali141 opened this issue 8 years ago • 0 comments

I am crawling the job-posting of linkedin with the crawlera enabled. But the most of the time i am getting the respose code 503 and 500. i have even added a limited number of retries with the response 5xx. Note: The spider is working fine on my local machine without the crawlera enabled, but not working on the scrapinghub without the crawlera enabled.

Waqar-ali141 avatar Feb 16 '16 12:02 Waqar-ali141