Justus Magin

Results 244 comments of Justus Magin

mostly for experimentation with `dask-ctl`, but I have also been using `LocalCluster` in a pipeline with multiple commands that don't know how to create clusters. In this case I'm also...

If I [understand](https://bugs.python.org/issue42717) correctly, the issue is that there are daemon threads (those with `thread.daemon = True`) involved somewhere that try to print to `stderr` on shutdown (which might have...

closing, since anything still missing should be feature requests for `xncml`

My knowledge of jobqueue systems is pretty limited, but I wonder if it would be possible to use environment variables for this? This is a standard OS feature so it...

After some investigation this seems a bit trickier than I had anticipated. As far as I understand it, what happens in `CombineReferences` is that `CombineMultiZarrToZarr` (a `CombineFn` subclass) is repeatedly...

Apologies for abandoning this. I no longer believe it is a good idea to resolve this here by passing along the urls, instead I think `kerchunk` should allow extracting additional...

another option would be to have `OpenWithXarray` use an `engine` (`xr.open_dataset` backend) that immediately knows what to do with the references (the `"kerchunk"` engine discussed in fsspec/kerchunk#360?)

I'm not working on this nor am I planning to at the moment (and I'm not aware of anyone else doing so), but the development will most likely happen on...

There's some discussion about this on the [pangeo discourse](https://discourse.pangeo.io/t/using-dask-to-parallelize-plotting/1179). The result of that discussion seems to be a new [library](https://github.com/ahuang11/streamjoy) aiming to implement streaming saves instead of writing images then...

just wondering: should we put datatree examples into their own subdirectory? At the moment, anything in the repository root is picked up by `xr.tutorial.open_dataset`.