zstd icon indicating copy to clipboard operation
zstd copied to clipboard

How to accelerate the process of dictionary training in zstd?

Open riyuejiuzhao opened this issue 1 year ago • 5 comments

I am facing a time-consuming issue with zstd dictionary training when working with large datasets. The slow process has led me to search for ways to speed it up.

I would be grateful for any suggestions, code examples, or guidance on how to accelerate the dictionary training process using the zstd library. Although I want to use multithreading for dictionary training, I am unsure about how to implement it.

Thanks

riyuejiuzhao avatar May 23 '24 09:05 riyuejiuzhao