Tom Nicholas
Tom Nicholas
@cisaacstern and I were wondering what was the rationale of the lithops project making your own implementation for the lithops [cloud proxy storage API](https://lithops-cloud.github.io/docs/source/api_storage_os.html). There are other libraries that deal...
### Best approach to support reading data from http via a `pathlib`-like class, i.e. `httppathlib`? In the [pangeo](https://pangeo.io/) / [xarray](https://xarray.dev/) community we do a lot of reading of remote scientific...
I don't know anything really about the format of MITgcm output files other than that they are some bespoke binary format, but I can't help wonder if it would actually...
For a while I've been thinking that Cubed and `dask.array` are potentially on a path of convergent evolution to a very similar design. After talking to @phofl at length at...
The current text on [why cubed?](https://cubed-dev.github.io/cubed/getting-started/why-cubed.html) is written at a very high level. It's very interesting for people who think about different distributed systems, but it's not super clear to...
In #554 and #555 @applio started to add support for running Cubed on Dragon, with the intention of allowing users to run Cubed on HPC. One thing that's super nice...
@dcherian's PR to xarray https://github.com/pydata/xarray/pull/9320 adds a new primitive to the ChunkManager, which presumably should be added to cubed too?
**I think we need a single general solution for how to store metadata which scales with the number of chunks in an array.** ### Context Zarr aims to be arbitrarily...
### What is your issue? The `DataTree` structure was not designed with performance of very large trees in mind. It doesn't do anything obviously wasteful, but the priority has been...
_Originally posted by @aladinor in https://github.com/pydata/xarray/issues/9511#issuecomment-2405191800_ Hi everyone, I've been working with hierarchical structures to store weather radar. We’re leveraging xradar and datatree to manage these datasets efficiently. Currently, we...