Ryan Abernathey

icon indicating a website link https://github.com/rabernat

icon company Earthmover PBC icon location New York City icon location Open source maintainer. CEO and co-founder of @earth-mover. @pangeo-data creator. Professor of Earth and Environmental Sciences at Columbia University.

Results 1264 comments of Ryan Abernathey

Array indexing with Zarr 3 is noticeably slower than with Zarr 2

> Anemoi's indexing virtually combine several Zarr (join, subset, etc.) and will internally call Zarr's indexing This is interesting to us independently of this issue. Xarray has some support for...

Array indexing with Zarr 3 is noticeably slower than with Zarr 2

Xarray is great at these sorts of selection / merging / pre-processing operations. Is there a reason you can't use or at least build on Xarray here? This blog post...

Array indexing with Zarr 3 is noticeably slower than with Zarr 2

> We want all variables for one date in the same chunk, not one array per variable... The idea is to have a chunk representing exactly the tensor that we...

add numcodecs.zarr3.to_zarr3 method

> My preference would be to move _away_ from separate zarr 2 and zarr 3 codec classes, which would look somewhat different than the effort here. Are these mutually exclusive?...