Jack Kelly

Maybe one solution is to include multiple timesteps per chunk. Eg have three arrays: one with two hours at 00, 15, 30, and 45. Another at 05, 20, 35, 50....

Hi David, thanks for getting in touch, and sorry for the very slow reply! I'm afraid we're not actively developing OptiFlow any more, and its weights aren't on HF. We...

It's possible that "blurry" predictions might still allow a downstream neural net to predict solar PV yield, and that the downstream neural net might learn to interpret the "blurry" predictions...

`nwp_path` sounds good to me! Maybe we should change all the `_zarr_path` attributes (e.g. also change `satellite_zarr_path` to just `satellite_path`) to be consistent across `DataSource`s?

I'd love to see a batched Store API in Zarr-Python! (Just to connect the dots: [Here's an informal proposal](https://github.com/zarr-developers/zarr-python/discussions/1569#discussioncomment-7576554) I wrote for a `Store.get_items` method for Zarr-Python... which includes links...

On the question of sharing a queue between Python and Rust: I like the idea. But I've [searched the PyO3 GitHub organisation for "queue"](https://github.com/search?q=org%3APyO3+queue&type=code&p=1) and haven't found anything relevant :disappointed:...

ah, yes, of course... sorry.... :flushed:... I need to re-read the Zarr v3 spec soon :slightly_smiling_face: ! On the topic of sharing a queue between Rust and Python... In [a...

> The scope of light-speed-io seems to be aligned with the scope of CodecPipeline. Though, I don't quite understand how light-speed-io would interface with existing Codecs. Would those be python...

> I don't quite understand how light-speed-io would interface with existing Codecs. Would those be python calls into the Codec API from Rust? My plan is for `light-speed-io` to call...

Sounds great! Thank you for the explanation. I'll try to enable my little [`light-speed-io`](https://github.com/JackKelly/light-speed-io) Rust crate to provide `CodecPipeline`-like functionality (fetching data from IO, decoding, assembling chunks into 1 output...