zstd icon indicating copy to clipboard operation
zstd copied to clipboard

Add dictionary-in-stream format in contrib

Open yotann opened this issue 4 years ago • 11 comments

Adds a format in contrib/dict_in_stream that stores a dictionary, optionally compressed, in a skippable frame at the beginning of a stream. This format is useful to reduce the size of streams that have many frames. For instance, Wget-AT is using this format to compress WARC files using one frame per record and allow random access.

cc @JustAnotherArchivist

yotann avatar Oct 11 '20 21:10 yotann