scio
scio copied to clipboard
Wrap coders in Zstd coders
In theory this will reduce shuffle/streaming data processed cost
Needs a dictionary of common symbols to be provided
In theory this will reduce shuffle/streaming data processed cost
Needs a dictionary of common symbols to be provided