wget icon indicating copy to clipboard operation
wget copied to clipboard

Too many fds open. Cannot use select on a fd >= 64

Open ZombiePm opened this issue 5 years ago • 6 comments

Too many fds open. Cannot use select on a fd >= 64 why? How Change?

ZombiePm avatar Jan 20 '20 10:01 ZombiePm

resolved? i meet the same problem when i open 9 OR 10 wget in the same time..... my computer, window10/ 8G/i7

shin701 avatar Oct 25 '20 14:10 shin701

I have this problem using --spider. I am trying to fetch url from a domain. I tried to use --wait, -timeout but did not succeed. I restarted my computer thinking that some background fds were still opened, did not change.

Does it exist a solution to avoid too open too many fds at the same time ?

DGrv avatar Aug 15 '21 19:08 DGrv

Same issue here. What to do? W10 --mirror

Slobodoslav avatar Oct 23 '21 16:10 Slobodoslav

Con someone please provide a way to reproduce this issue?

darnir avatar Oct 24 '21 11:10 darnir

More specifically, the exact command you're using and the environment. All our development and testing is done on GNU/Linux, and I haven't come across this issue before

darnir avatar Oct 24 '21 11:10 darnir

This is probably issue on windows only. FD_SETSIZE is set to rather low - to only 64 sockets - as it is described by error message. On Linux it is "probably/definitely" set (by default, or intentionally) to higher value (1024?).

Solution is easy and described in last comment here: https://stackoverflow.com/questions/7976388/increasing-limit-of-fd-setsize-and-select/14929259

(actually there IS a way to increase FD_SETSIZE on windows. its defined in winsock.h and per microsoft themselves you can increase it by simply defining it BEFORE you include winsock.h ... )

Slobodoslav avatar Oct 24 '21 16:10 Slobodoslav