streamly icon indicating copy to clipboard operation
streamly copied to clipboard

Limit the number of open fds in recursive directory traversal to a defined value

Open adithyaov opened this issue 9 months ago • 1 comments

A lot of open FDs cause the flow to fail with:

       uncaught exception: IOException of type ResourceExhausted
       benchmark-tmp/dir-structure/dir_4/dir_3/dir_2/dir_5/dir_5: openDirStream: resource exhausted (Too many open files)

This is true in case of BFS.

adithyaov avatar Feb 17 '25 18:02 adithyaov