Tom Nicholas
Tom Nicholas
> I suspect this actually needs a different implementation, in order to handle error recovery properly. > > I would suggest handling this like `Dataset._inplace_binary_op`, which builds result `Dataset` and...
### What is your issue? _From https://github.com/xarray-contrib/datatree/issues/199_ Currently you can perform arithmetic with datatrees, e.g. `dt + dt`. (In fact the current implementation lets you apply arbitrary operations on n...
### What is your issue? This isn't currently possible - but it's not simple to imagine how it might work. See https://github.com/xarray-contrib/datatree/issues/193 for previous discussion.
### What is your issue? I've always felt this was unnecessarily confusing. We have multiple "backends" that are selected through the `engine` kwarg to `open_dataset`, which ultimately calls an instance...
### What is your issue? I'm writing more documentation for DataTree, and was looking for an in-depth explanation of what Alignment actually is so I can refer to it, but...
# :rotating_light: :bell: :warning: NO LONGER MAINTAINED :warning: :bell: :rotating_light: **This repository has been archived and the code is no longer maintained!** Datatree has been [merged upstream into `pydata/xarray`](https://github.com/pydata/xarray/issues/8572), and...
### Concept Icechunk solves the problem of handling incremental updates to Zarr stores, meaning that users can transparently track changes to datasets at the chunk level. Often real-world data pipelines...
One of Matt Rocklin's blog posts [mentions](https://docs.coiled.io/blog/2024-eoy.html#whats-next) Prefect's "serverless work pool" https://docs.prefect.io/v3/deploy/infrastructure-examples/serverless My (hazy) understanding of what this is is a way to deploy a cluster in the cloud on-demand...
@betolink was asking if there is a way to keep track in Dask of the accumulative network traffic for pulling data, but I think Cubed should have enough information to...
Maybe useful? Could simply roll back to state before failed stage. Also then it's Icechunk 's problem to worry about atomic writes... Idea from: A reason to not run backup...