Davis Bennett
Davis Bennett
good point @will-moore; https://github.com/zarr-developers/zarr-python/pull/1952 should address this
the script you included does not include all the dependencies. Here's a modified version that does: ```python # /// script # requires-python = ">=3.11" # dependencies = [ # "zarr@git+https://github.com/zarr-developers/zarr-python.git@main",...
the http filesystem does something similar. I feel like this method should actually be called `_strip_protocol_or_return_the_input_unchanged`, and then it would be clear to simply not use it.
these are the relevant zarr code sections for your use case: https://github.com/zarr-developers/zarr-python/blob/5a24487f09d499c91ce25f24af910c2ede055b5a/src/zarr/storage/_fsspec.py#L250-L256 https://github.com/zarr-developers/zarr-python/blob/5a24487f09d499c91ce25f24af910c2ede055b5a/src/zarr/storage/_fsspec.py#L142-L145 Evidently you can find them by searching for `(¯\_(ツ)_/¯)` We already have an exemption for http, we...
that's good news. it would be nice to avoid explicit special cases here though. maybe we should fall back to generic URL parsing instead of relying on the nearly worthless...
I'll have a look later today
> I'm running into an issue where there doesn't seem to be a storage option in Zarr 3 that would let me write to different chunks in the same array...
Sharding was introduced in Zarr v3. The typical usage for Zarr V2 was 1 chunk : 1 file. Other than zip storage, I'm not aware of any support for packing...
> Additionally, in many cases right now, the CPU->GPU transfer is absolutely not the bottleneck. For example, I might have a remote zarr array that has 1K x 1K tiles,...
> Would using `null` as a placeholder for all recommended but not required field have consequences for the validation? I.e., would the validator encounter `null` and skip the warning it...