zstd icon indicating copy to clipboard operation
zstd copied to clipboard

Hope to Add a Read Buffer Option

Open cwcpu opened this issue 5 months ago • 0 comments

Is your feature request related to a problem? Please describe.

I have the following scenario:

A 12TB mechanical hard drive with a 1TB file compressed using zstd. During decompression, I noticed that the disk is both reading and writing at the same time — approximately 80MB/s read and 50MB/s write. However, if reading or writing separately, the speed can exceed 250MB/s. The CPU usage of zstd is around 20%.

I suspect the performance issue is due to disk seek operations. I would like to be able to sequentially read 1–5GB into memory first, then decompress to disk. I believe this would be faster. Thank you.

Describe the solution you'd like Hope to Add a Read Buffer Option

cwcpu avatar Aug 05 '25 07:08 cwcpu