link-checker icon indicating copy to clipboard operation
link-checker copied to clipboard

Error: Too many open files - link-checker-crawled-pages.pstore

Open ehoch opened this issue 12 years ago • 4 comments

Love the gem! But unfortunately, it's not working for me on my large site.

I end up with errors only a few thousand links into my several hundred thousand page site, http://www.thehollywoodgossip.com

Are there settings / tweaks I can make to make this work?

ehoch avatar Oct 26 '12 13:10 ehoch

Hi, sorry for the delay. I'm not sure why the process is opening too many file handles. But I'll try to figure it out by reproducing your findings with http://www.thehollywoodgossip.com. Thanks for the report.

endymion avatar Nov 15 '12 19:11 endymion

Same issue here while testing the "public" folder in my local Octopress.

How can be solved? many thanks!

mbarulli avatar Apr 16 '13 13:04 mbarulli

Find:

threads << check_page(open(file), file)

Replace with:

threads << check_page(File.open(file, 'r:utf-8', &:read), file)

Paxa avatar Sep 25 '14 12:09 Paxa

@ehoch, solution from @Paxa works. Please close the issue.

karlosmid avatar Jul 31 '15 10:07 karlosmid