zstd
zstd copied to clipboard
facebook
Zstandard - Fast real-time compression algorithm
**Is your feature request related to a problem? Please describe.** i hope compression will be supported on gpu to compress vram on the fly https://www.blosc.org/pages/blosc-in-depth/ for example this compression method...
**Describe the bug** The dict trainer fails with SIGSEGV or floating point exception **To Reproduce** ``` #include #include const char * samples = "0123456789abcdefghij"; const size_t sizes[20] = {1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1}; const...
In streaming compression, memory usage is very important. We recently added the capability to split the literals between the output buffer & the dctx. But the size of this buffer...
**Describe the bug** zstd's test suite fails on HPPA. Specifically, the `test: check if binary has executable stack` test fails because of an executable stack. On HPPA, this is actually...
This issue manifests as truncated data when using zstdcat on some files that have an unterminated frame. When the frame is unterminated, `ZSTD_decompressStream` does not keep [hostage input bytes](https://github.com/facebook/zstd/blob/838f96a9559d431d8d57d5883d7b67fd8df25ada/lib/decompress/zstd_decompress.c#L2324). In...
**Is your feature request related to a problem? Please describe.** We use zstd to compress log files which are then later read and replayed. Due to the fact the files...
`zstd` supports the concatenation of multiple frames, zstd and skippable, in a single stream. The decoder determines the boundaries of each frame, and properly decodes the complete stream. However, in...
The dictionary reload conditions are: https://github.com/facebook/zstd/blob/9b4833df2de3ab1779474c08725e398ea96127a1/lib/compress/zstd_compress.c#L5012-L5020 Should `cdict->compressionLevel == 0` be `cdict->compressionLevel != 0`? If a dictionary is from `ZSTD_CCtx_loadDictionary()`, `cdict->compressionLevel` is 0. If a dictionary is from `ZSTD_CCtx_refCDict()`, `cdict->compressionLevel`...
Hi, I would like to know what are the differences between actual decompressor and educational decompressor. Few things i noticed are : Educational decoder decodes literal streams one after the...
Publish a validation decoder, which role is to be very strict about what is allowed by the spec., and flags whatever content doesn't follow the spec. strictly, in order to...