Nick Terrell

[reproducibility] Zstd varies compressed output based on the presence of SSE / NEON in some cases

5

https://github.com/facebook/zstd/blob/0ff651dd876823b99fa5c5f53292be28381aee9b/lib/compress/zstd_compress.c#L238-L249 We haven't historically strongly guarantee reproducibility across compilations on different systems. However, we've been moving in this direction. We should consider removing this source of difference, either by default...

Try out `-fbounds-safety` in the LZ4 codebase. It is available in this fork of LLVM https://github.com/swiftlang/llvm-project/pull/9707 https://clang.llvm.org/docs/BoundsSafety.html

Zstd doesn't always create RLE blocks

3

``` cat

Currently the training API offers one preset configuration `--train` that offers a medium CPU to quality tradeoff. But there are many different parameters, which are non-trivial to understand. We should...