colly icon indicating copy to clipboard operation
colly copied to clipboard

colly OnError shows EOF error for the given website

Open kiranupadhyak opened this issue 4 years ago • 4 comments

For my given website after the colly.Visit function, the colly.OnError shows Get "{website}": EOF. When I check the StatusCode it shows 0 Why?. Is I'm missing anything?

Note: the URL is working in browser & curl action. (it's a non-https URL)

kiranupadhyak avatar Jan 25 '21 18:01 kiranupadhyak

It's impossible to tell from this information alone.

I suppose "non-https URL" means "HTTP"? If you don't want to share the website URL with us, you could capture the network traffic with tcpdump/Wireshark and see if there's something obviously wrong.

WGH- avatar Mar 03 '21 13:03 WGH-

I experienced this today. After seeing that error, I visited that link with Chrome Browser, but it seemed fine.

I think the target page was down shortly because of too fast crawling requests on the specific site.

In my case, adding dalay sovled the phenomenon.

roeniss avatar Mar 25 '23 19:03 roeniss

I also encountered this error caught in the error handle All requests will get: Post "Url": EOF This error disappeared after I restarted the program But after some time this problem occurs again. This is an obscure error, i don't know how to fix it.

jamesfyp avatar Mar 26 '23 13:03 jamesfyp

I have the same issue! I don't need to scrape the body of a resource, I just need to check if it exists using c.Head(url), but it returns EOF error. I tried to circumvent this by using the onError callback but another problem arises when used in combination with the async config, the callback seems to be called multiple times... maybe is this a clue?

riklus avatar Dec 11 '23 16:12 riklus