zarrs-python icon indicating copy to clipboard operation
zarrs-python copied to clipboard

Variable-Sized Data Types handling

Open ilan-gold opened this issue 1 year ago • 1 comments

Once this lands in zarr-python we should update here, if I understand things correctly.

https://github.com/zarr-developers/zeps/pull/47

ilan-gold avatar Oct 02 '24 10:10 ilan-gold

This shouldn't be too hard on the zarrs-python side:

  • Convert Python variable length arrays to the zarrs representation ArrayBytes::Variable
  • Search for into_fixed(), new_flen() and add variable length support

There is an incompatibility between zarrs and zarr-python for variable-sized binary data that I am inclined to address in the next release. zarrs uses the Binary data type (matching ZEP0007) and zarr-python uses Bytes.

LDeakin avatar Dec 02 '24 20:12 LDeakin