readr icon indicating copy to clipboard operation
readr copied to clipboard

Add support for ZSTD compression/decompression

Open eroberson opened this issue 2 years ago • 0 comments

readr currently supports gz, bz2, xz, and zip. The ZSTD compression format has potentially better compression and streaming decompression performance overall than these other formats. Given the ever increasing size of datasets, the cost of storing uncompressed data, the need for performant decompression on demand, and the support readr already has for seamless reading/writing to compressed formats, it's worth exploring adding this algorithm to the package.

ZSTD description

ZSTD repo

eroberson avatar Aug 22 '22 14:08 eroberson