multiscale-spatial-image icon indicating copy to clipboard operation
multiscale-spatial-image copied to clipboard

zarr 3

Open thewtex opened this issue 10 months ago • 4 comments

  • COMP: Zarr Python 3 StoreLike support
  • COMP: Use LocalStore for Zarr Python 3
  • COMP: Remove dimension_deparator arg to MemoryStore
  • Remove home-page from pyproject.toml

thewtex avatar Feb 14 '25 15:02 thewtex

xref: https://github.com/astropenguin/xarray-dataclasses/issues/240

thewtex avatar Feb 25 '25 02:02 thewtex

Hi @thewtex, sorry for the radio silence. Is there part here you would like help with or we can share the workload a bit?

melonora avatar Mar 06 '25 09:03 melonora

@melonora thanks for the offer to help :pray:

We are currently blocked by astropenguin/xarray-dataclasses#240 , which prevents resolution of a valid dependency tree.

A forked version could be published and used until it is resolved.

thewtex avatar Mar 06 '25 12:03 thewtex

I can have a look early next week

melonora avatar Mar 06 '25 13:03 melonora

Hey, just wanted to nudge a little bit - here on NixOS we are still waiting for this PR :).

doronbehar avatar Jul 17 '25 07:07 doronbehar

Apologies, I got overthrown later with lab work. I had a look at the repo and the problem is now that the person owning the repository seems to have deleted all the code on main right now. I will pull the last working release and work from there. Alternatively, check if we can get away with not using it.

melonora avatar Jul 19 '25 12:07 melonora

@doronbehar The fork on my branch is I think almost ready after I fix the conflicts. I would like to have one look with @thewtex before releasing from my fork, but then after this we can adjust this PR and get it merged.

As said before, from the original repository all the code on main got deleted. It seems like the maintainer was in the process of moving to the use of dataspecs but didn't have time to complete it. The release of the fork would now only adjust the xarray constraints. I will check whether after that I can finish the maintainers work on the migration to dataspecs but that would take a while as I am also finishing my PhD.

melonora avatar Jul 21 '25 13:07 melonora

@doronbehar I discussed with @thewtex and we think it is best to move the fork to the xarray org, where it could be better maintained. I have opened an issue on the original repository explaining the situation and asking whether we could get the permissions on PyPi so we can release under the same name. (https://github.com/astropenguin/xarray-dataclasses/issues/244)

melonora avatar Jul 22 '25 00:07 melonora

CC @ianhi

thewtex avatar Jul 22 '25 19:07 thewtex

@doronbehar Just to update, I am trying to get the repository in the xarray-contrib organization right now, see https://github.com/xarray-contrib/xarray-contrib/issues/16

melonora avatar Jul 24 '25 14:07 melonora

@doronbehar @thewtex xarray-dataclass has been released. I pushed the change here already, but looks like we have some more work to do.

melonora avatar Jul 30 '25 11:07 melonora

@melonora woohoo! :sparkler:

It looks like zarr-python 3 issues?

thewtex avatar Jul 30 '25 11:07 thewtex

https://github.com/copilot/c/530f9ab4-b665-4d7b-9321-f0463b89ba93

thewtex avatar Jul 30 '25 12:07 thewtex

hmm can't see that conversation, but I will check later

melonora avatar Jul 30 '25 12:07 melonora

Todo:

  • [x] migrate spatial-image to xarray-dataclass
  • [x] test updates for zarr v3

thewtex avatar Jul 30 '25 13:07 thewtex