compressed json

[janrito]

looks like datafusion just shipped the ability to read compressed data – such as gziped json https://github.com/apache/arrow-datafusion/pull/3642#pullrequestreview-1137722818

[timvw]

It would be awesome to have some test which verifies that this works

[janrito]

I tried it today, but I'm not sure how to tell qv that it should use json as the file type.

qv "s3://path/to/bucket/*.json.gz"
Error: Internal("Unable to infer file type from suffix gz")

[janrito]

🤘