zstd
zstd copied to clipboard
Shrink literal decoding buffer for streaming compressiong
In streaming compression, memory usage is very important. We recently added the capability to split the literals between the output buffer & the dctx. But the size of this buffer is fixed at compile time. We should either:
- Allow this to be configurable at runtime, so that users can choose the speed vs. memory usage tradeoff.
- Shrink the compile time constant down to be small enough to suit most use cases, like 4KB or maybe 16KB.