colly
colly copied to clipboard
colly OnError shows EOF error for the given website
For my given website after the colly.Visit
function, the colly.OnError
shows Get "{website}": EOF. When I check the StatusCode
it shows 0
Why?. Is I'm missing anything?
Note: the URL is working in browser & curl action. (it's a non-https URL)
It's impossible to tell from this information alone.
I suppose "non-https URL" means "HTTP"? If you don't want to share the website URL with us, you could capture the network traffic with tcpdump/Wireshark and see if there's something obviously wrong.
I experienced this today. After seeing that error, I visited that link with Chrome Browser, but it seemed fine.
I think the target page was down shortly because of too fast crawling requests on the specific site.
In my case, adding dalay sovled the phenomenon.
I also encountered this error caught in the error handle All requests will get: Post "Url": EOF This error disappeared after I restarted the program But after some time this problem occurs again. This is an obscure error, i don't know how to fix it.
I have the same issue! I don't need to scrape the body of a resource, I just need to check if it exists using c.Head(url)
, but it returns EOF error. I tried to circumvent this by using the onError
callback but another problem arises when used in combination with the async config, the callback seems to be called multiple times... maybe is this a clue?