indexed_gzip
indexed_gzip copied to clipboard
pauldmccarthy
Fast random access of gzip files in Python
For unseekable files, can't build full index by reading the entire file. I have to run `build_full_index`, but I can't just instead read the entire file to build the index...
This is because it appears that when I try to build an index by reading an unseekable file through the entire way (as opposed to `build_full_index()`), it gives me a...
Currently the index is built: - On calls to `zran_seek(n)` - the index is bulit to cover up to position `n` in the uncompressed data - On *successive* calls to...
I'm interested in using the `zran` functionality that is present within `indexed_gzip` with files that are not `gzips`, but were also compressed using `zlib` (e.g., `zlib` compressed zip files). However,...
Re-arrange the C code such that: * It can be compiled against either [`zlib`](https://zlib.net/) or [`zlib-ng`](https://github.com/zlib-ng/zlib-ng) * It can be compiled as a native C library (without having to link...
How to test: ```bash # setup bash ./.ci/create_test_env.sh venv source ./.ci/activate_env.sh venv # run tests: bash ./.ci/build_dev_indexed_gzip.sh venv && bash ./.ci/run_tests.sh venv ```
I would like to use `indexed_gzip` to download only the relevant portions of a `.gz` file via a ranged `GET` request. I understand that you cannot use `indexed_gzip` to download...
Looks like some of our users when installing indexed_gzip are having pip build wheels (https://github.com/codalab/codalab-worksheets/issues/4427). Do you know if indexed_gzip builds wheels for ubuntu 22?
Hello @pauldmccarthy this package is really fantastic! I work at the [Alaska Satellite Facility](https://asf.alaska.edu) where we distribute satellite imagery data at no cost to scientists and we've run into a...