xarray-beam icon indicating copy to clipboard operation
xarray-beam copied to clipboard
verified publisher icon google

Race condition in ChunksToZarr when template is not supplied explicitly as an xarray.Dataset

Open shoyer opened this issue 2 years ago • 1 comments

Due to https://github.com/zarr-developers/zarr-python/issues/1435, ChunkToZarr can result in invalid Zarr files if the template is written simultaneously from different workers.

shoyer avatar Jul 07 '23 16:07 shoyer

https://github.com/google/xarray-beam/pull/112 partially resolves this issue, by deprecating using ChunksToZarr without a template.

shoyer avatar Feb 18 '25 21:02 shoyer