Björn Harrtell

@rouault yes please, I'd like to revisit this shortly.

Yes that is from what I understand the purpose of the frames. https://tukaani.org/xz/format.html describes it as "The data can be split into independently compressed blocks. Every .xz file contains an...

If I understand correctly zstd might get official framing support one day (see https://github.com/facebook/zstd/issues/395).

Looks like I have misunderstood lz4, according to discussion at https://github.com/lz4/lz4/issues/187 it does not support random access (out of the box).

Looks like xz shows more promise, I'll switch my efforts to that.

Revisiting this I'm again considering looking into lz4. I think I misunderstood twice... and that it does support random access when compressing using independent blocks which does seem to be...

Still interested in this.. and I note liblz4 is now available in GDAL for other purposes.

Interesting - https://github.com/vasi/pixz - and - https://github.com/martinellimarco/t2sz.

Hmm and again I'm back to probably misunderstood lz4 frame format.. quote from https://github.com/lz4/lz4/blob/dev/doc/lz4_Frame_format.md#introduction - "The data format defined by this specification does not attempt to allow random access to...

I would pursue vsixz but the decompression speed is no fun. Seems everyone is moving away from xz these days. But it's definitely sad that random access has moved to...