Add testing on Azurite to the CI

Open maxrjones opened this issue 6 months ago • 1 comments

The FSSpecStore and ObjectStore stores are meant to be cloud agnostic, but only the behavior on S3 is tested using minio. I'm wondering if it'd be worthwhile to use Azurite to test using Zarr-Python on a non-S3 compatible API. The motivation is that it may have caught errors like https://github.com/zarr-developers/zarr-python/issues/3136, which has a fix that does not seem to be covered by the current CI despite a unit test.

I couldn't find a similar emulator for GCS that's production ready.

Jun 18 '25 12:06 maxrjones

We're in a similar situation for our own projects as well haha, right now we also only test against in-memory, local storage and s3 using moto - so watching this issue since I'm curious how this will develop

For GCS there is fake-gcs-server, but I don't know how production ready that is, haven't gotten around to trying it yet.

Jun 18 '25 14:06 lukasbindreiter