python-neo icon indicating copy to clipboard operation
python-neo copied to clipboard

Proof of concept of "buffer_description_api" and xarray reference API bridge

Open samuelgarcia opened this issue 1 year ago • 1 comments

Given the idea of @bendichter and this gist

Here a very very early stage of a very very proof of concept of the "buffer_description_api" for analogsignal chunk.

The idea/goal is:

  • have a simple buffer description for analogsignal for binary or hdf5 cases (maybe more)
  • this description can be exported to json
  • this description can be easily transformed to the xarray/zarr reference external API
  • make so file cloud ready for streaming chunk of traces

See also kerchunk

samuelgarcia avatar Jul 26 '24 10:07 samuelgarcia

Looks good!

bendichter avatar Jul 26 '24 11:07 bendichter

Merci beaucoup @zm711 and @h-mayorquin for the review

samuelgarcia avatar Oct 21 '24 11:10 samuelgarcia

@zm711 @h-mayorquin @alejoe91 This is OK on my side. test are passing I think we can merge this soon. we will be able to update stream and buffer on reader per reader basis later.

samuelgarcia avatar Oct 23 '24 16:10 samuelgarcia

yeah!! merci fois pour l'aide.

samuelgarcia avatar Oct 25 '24 15:10 samuelgarcia