cmdstan icon indicating copy to clipboard operation
cmdstan copied to clipboard

support compressed data files

Open bob-carpenter opened this issue 4 years ago • 0 comments

Summary:

Support compressed data files with appropriate suffixes.

Description:

Most data files are highly compressible and compressing cuts down on storage and transport cost.

The behavior should be equivalent to decompressing and then processing, but no intermediate file needs to be created.

Names should follow the usual convention, such as foo.json.gz.

Additional Information:

It looks like Boost has gzip and zip in its iostreams library.

I haven't gotten to the bottom of licensing issues with the zip decompressors. There are several out there.

Current Version:

v2.27.0

bob-carpenter avatar Sep 01 '21 15:09 bob-carpenter