sfm-ui icon indicating copy to clipboard operation
sfm-ui copied to clipboard

Consider offering gzipped Full JSON as an export type

Open kerchner opened this issue 8 years ago • 2 comments

Compression on Full JSON is roughly a 1:8 ratio, so on a large extract (such as an extract from Sample Stream), providing the export gzipped could make transfer much easier. Consider applying gzip as an option (perhaps a checkbox?) that could apply to any export type.

This came up in the context of preparing for Prof. Broniatowski's class, EMSE 4197, as we would like to offer students the option to export data from the Twitter samplestream; these exports can be quite large in their raw, non-zipped, form.

kerchner avatar Sep 13 '16 20:09 kerchner

Discuss with @justinlittman whether to gzip all the files together or gzip individual files. Priority is full JSON export type.

lwrubel avatar May 11 '17 17:05 lwrubel

For this ticket, gzip individual files, not the whole set of export files.

lwrubel avatar Jun 22 '17 15:06 lwrubel