flate2-rs icon indicating copy to clipboard operation
flate2-rs copied to clipboard

Reading multiple GZIP archives in one file, individually

Open matthewrobertbell opened this issue 5 years ago • 1 comments

Hi,

I have a large .gz file with many (hundreds of thousands) individual archives in the one file.

Using GZDecoder works on this, for the first archive. Using MultiGZDecoder works, allowing me to produce one big string with data from all archives.

Since the archives are to be processed individually, and because it is hard to split the parts of data once they are all in one big string, I would like to produce something like an iterator of strings, one per archive. Is this possible currently? If not, is it something that is easy to build on top of flate2?

Thanks!

matthewrobertbell avatar Apr 25 '19 16:04 matthewrobertbell

I think you'd probably want to see how MultiGzDecoder works internally and probably copy that externally. I don't think it would be too too hard to set up though!

alexcrichton avatar Apr 26 '19 19:04 alexcrichton