xbatcher icon indicating copy to clipboard operation
xbatcher copied to clipboard

Blog post announcement: cloud native data loaders for machine learning using zarr and xarray

Open jhamman opened this issue 1 year ago • 0 comments

What is your issue?

We wanted to know if you could connect Zarr+Xarray+Xbatcher+Pytorch and get good performance during training so we wrote this blog post: https://earthmover.io/blog/cloud-native-dataloader

Code is here: https://github.com/earth-mover/dataloader-demo

I think folks here will find it interesting. Let me know what you think.

BTW, once #202 is in, most of the custom bits in the demo will be unnecessary.

jhamman avatar Mar 14 '24 17:03 jhamman