Alistair Miles
Alistair Miles
Hi @Cedric-LG, just to say the PR looks great, I'll look at adding some tests.
Just to refresh here, I still think this would be a useful change, just needs some tests.
Thanks Ryan, pyfilesystem certainly looks like something we should investigate. And I am certainly open to this general approach if the underlying libraries are well maintained and performant and we...
I think what @rabernat is probably getting at is that if you want to do a chunk-wise computation over a zarr array, and you want to parallelise some part of...
Hi David, thanks a lot for elaborating, sounds very interesting and very happy to look at API enhancements that would make it easier to use zarr from your framework. Not...
Hi @David-Baddeley, thanks for following up. It would be pretty straightforward to turn the [``Array._chunk_getitem()``](https://github.com/zarr-developers/zarr-python/blob/121e9ecc08b3a6354e6620b8e20423e37517942e/zarr/core.py#L1552) method into a public method, and also make some of the arguments optional. So, e.g.,...
Thanks @amatsukawa for commenting. FWIW I'd still be happy for such a function which returns a specific chunk as a numpy array, given chunk indices. Happy for that to go...
It might be helpful to know when you would want to verify data integrity. E.g., would you want to verify a chunk every time it was read? Or something else?
Hi Tony, I think I would suggest two possible approaches. One would be to adopt a convention where you write a checksum file alongside every chunk file into your zarr...
Thanks @jakirkham, very good idea to raise this. FWIW I think as a minimum, a store: * must implement the ``MutableMapping`` interface * must support keys that are ASCII strings...