juicefs icon indicating copy to clipboard operation
juicefs copied to clipboard

Make max-readahead configurable to enhance read performance

Open ddrid opened this issue 1 year ago • 1 comments

Currently, readAheadMax is a non-configurable parameter for fuse users, set by default to conf.Chunk.BlockSize * 8, typically 32MB. This isn't sufficient for low-concurrency read requests. I intend to make max-readahead a user-configurable parameter.

After testing, I set max-readahead to 512MB and observed that under single-threaded, with uncached local disk reads, the throughput increased from 230MB/s to 2.2GB/s, showing a 10x improvement.

ddrid avatar Oct 12 '24 02:10 ddrid

Thanks for the PR. Maybe also document it (in docs) too?

solracsf avatar Oct 12 '24 17:10 solracsf

we can provide --max-readahead to overwrite this default setting.

davies avatar Mar 03 '25 07:03 davies