zstd
zstd copied to clipboard
Zstandard - Fast real-time compression algorithm
This function (`ZSTD_createDDict_byReference`) is used by RocksDB, and long has been. It is essentially required for digested dictionary support so that we can manage raw bytes ourselves without memory duplication....
This PR adds support to Zstd for handling the header used by the `dcz` HTTP Content-Encoding, described in [`draft-ietf-httpbis-compression-dictionary`](https://www.ietf.org/archive/id/draft-ietf-httpbis-compression-dictionary-19.html#name-dictionary-compressed-zstan). To-Do: - [x] SHA-256 Impl. - [x] SHA-256 Tests. - [x]...
This PR adds convenience options that ensure Zstd produces compressed outputs compatible with protocols that place limits on the window size. Currently, it supports two protocols: - The `zstd` HTTP...
It looks like the the multithreaded implementation in the base zstd is a bit slower than the other available threading implementations: zstd-mt : https://github.com/mcmilk/zstdmt/releases pzstd: https://github.com/facebook/zstd/tree/dev/contrib/pzstd One issue is the...
**Describe the bug** Hi, there. I am using makefile to build zstd on linux and gcc, using commands as follows. And i found the compile flag `-fno-tree-vectorize` is missing since...
**Describe the bug** For whatever reason, across multiple different compilers (msvc, clang, gcc) and C runtime libraries (ucrt, cygwin, msvcrt), the qsort step of `--train-cover` seems to take forever. Profiling...
Currently the training API offers one preset configuration `--train` that offers a medium CPU to quality tradeoff. But there are many different parameters, which are non-trivial to understand. We should...