xarray

xarray copied to clipboard

Thread-safety in xarray

6

### What is your issue? There's a process that can't use xarray because it's a multithreaded context, and xarray objects aren't thread-safe, because pandas indexes aren't thread-safe https://github.com/pandas-dev/pandas/issues/2728 I did...

max-sixty

Error converting zarr v3 to zarr v2: zarr 2 does not support "Serializer"

2

### What happened? I'm trying to convert a Zarr dataset in the Zarr format/version 3 to 2. Xarray can successfully read zarr v2 or v3. I can make an xarray...

rileyhales

Concurrent loading of coordinate arrays from Zarr

1

When you open a dataset with Zarr, xarray loads coordinate arrays corresponding to indexes in serial. This can be slow (multiple seconds) even with only a handful of such arrays...

shoyer

compatibility with zarr dtypes refactor

1

### What is your issue? This is an issue to track compatibility between xarray and the in-progress zarr-python data types refactoring effort. We are working on a new data type...

d-v-b

expose zarr caching from xarray

13

Zarr has its own internal mechanism for caching, described here: - https://zarr.readthedocs.io/en/stable/tutorial.html#distributed-cloud-storage - https://zarr.readthedocs.io/en/stable/api/storage.html#zarr.storage.LRUStoreCache However, this capability is currently inaccessible from xarray. I propose to add a new keyword `cache=True/False`...

rabernat

### What is your issue? The upcoming zarr-python PR: https://github.com/zarr-developers/zarr-python/pull/2874/ will change how zarr python 3 handles dtypes on zarr stores which will have implications for Xarray. I've run the...

ianhi

Add an asynchronous load method?

1

### Is your feature request related to a problem? Currently all xarray `.load()` calls are blocking, so the only way to concurrently load data for a bunch of different xarray...

TomNicholas

roundtripping bytes with specific _FillValue fails on Zarr 3.0.7

1

### What happened? Seen in CI. I have xfailed the Zarr test in #10255 ``` xarray/tests/test_backends.py::TestZarrDictStore::test_roundtrip_bytes_with_fill_value[2]: AssertionError: Left and right Dataset objects are not identical Differing data variables: L x...

dcherian

Cannot open netcdf file using engine h5netcdf with an MPI communicator

2

### What happened? Im just getting going writing an MPI accessor into xarray and I want to open netcdf files using h5netcdf and an MPI enabled h5py package. I can...

leonfoks

What options do I have for `<U#` type data saving in zarr?

8

### What is your issue? So I tried out `xarray` today with `zarr` version 3.0.4, and encountered these scary warnings: ``` /nix/store/qasysgiacqplrbda5yl65wg7jrs0gcjl-python3-3.12.9-env/lib/python3.12/site-packages/zarr/codecs/vlen_utf8.py:44: UserWarning: The codec `vlen-utf8` is currently not part...

doronbehar