Maximilian Knespel

> I meant: When using the default rapidgzip index and the same number of threads as without using the index, the decompression throughput is much higher due to ISA-L. When...

> > gztool already should give all the benefits > > I see. So except for index file size and the use case with `--count` option, there are no other...

I have fixed some of the performance ideas for `--count-lines`. > Yes, that's correct, because I would like to create the index asynchronously while compressing the data and not afterwards...

I have pushed a [commit](https://github.com/mxmlnkn/indexed_bzip2/commit/4fcfa86e63ebc2caa46175a399c7f6f6a8ddf41a) that should make your use case of using stdin input to create an index work to develop. You can try it out with: ``` python3...

No, there is no API documentation, yet. There are some doxygen comments but not for everything and I guess this doesn't help if you don't know where to look and...

> maybe you may check if its correct: Looks correct. > I was a little surprised by the necessity of using `-fconstexpr-ops-limit` Yeah, I guess this is something to be...

See https://github.com/mxmlnkn/indexed_bzip2/tree/single-pass-reader for an attempted implementation. I think I stopped working on that branch because the performance didn't look very good but still much better than single-threaded gzip. Also has...

> Assuming that https://github.com/mxmlnkn/ratarmount/issues/106 is caused by the non-sequential file access, then this addition might also fix that. We also need to detect when to use the sequential access pattern...

Partly fixed with https://github.com/mxmlnkn/indexed_bzip2/commit/9502781a9d2fa8b265fbe0a3b42177a1d5406836, but automatic detection is not yet implemented. Instead, I'm currently shooting for an `--sequential` or similar option. Maybe even make the pread the non-default case because...

I have trouble reproducing this. The traceback itself stems from the code logic that tries to remove the folder inside the overlay folder while it is not empty. The existence...