lnav icon indicating copy to clipboard operation
lnav copied to clipboard

File reading enters loop when opening many files

Open FaffeF opened this issue 2 years ago • 1 comments

lnav version v0.11.1

Describe the bug

The files windows shows a lot of files be read, but after a while it starts looping among a few of them, and never finishes.

To Reproduce To get around the file descriptors issue I raised the limit to 50000 using ulimit -n 50000.

lnav backup/*.gz (matches almost 6000 files)

FaffeF avatar Feb 01 '23 08:02 FaffeF

It seems like you've passed the scaling limits of lnav. lnav needs to read, parse, and index all of the files it is fed. So, loading thousands of files is going to take a long time and the results of that processing are not stored on disk.

tstack avatar Feb 07 '23 21:02 tstack