zstd-rs icon indicating copy to clipboard operation
zstd-rs copied to clipboard

Encoder improvements

Open KillingSpark opened this issue 1 year ago • 0 comments

General improvements

  • [ ] Add window size in frame header and stop using single segment for big frames (actually for raw/rle blocks a window size of 0 could be the correct value because no lookback is necessary for decoding?)
  • [ ] Add support for RLE blocks by scanning the input for big-ish regions of the same byte
  • [ ] Add support for actual compression using sequences (see #72 , this is a pretty big task)

Streaming support

  • [ ] Allow feeding input piecewise and not require one contiguous slice
  • [ ] Allow encoding into a slice piecewise and not require and growing a vec

KillingSpark avatar Oct 04 '24 11:10 KillingSpark