Anderson Banihirwe

Results 128 comments of Anderson Banihirwe

> I ran into the same issue. It seems like zarr is inserting VLenUTF8 as a filter, but the loaded data array already has that as a filter so it's...

> @jacobtomlinson gave CuPy a go a few months back. I seem to remember that he ran into a few problems but it would be good to get those documented...

@mjwillson, have you looked at https://github.com/carbonplan/xarray-schema? xarray-schema provides some of the functionality you are looking for... - Related to https://github.com/pydata/xarray/issues/1900

This appears to have been addressed: ```python In [15]: import dask_jobqueue In [16]: cluster = dask_jobqueue.SLURMCluster(cores=1, processes=1) In [17]: cluster.worker_spec Out[17]: {} In [18]: cluster.workers Out[18]: {} In [19]: cluster.scale(2)...

> However, it appears that the reported information can be misleading sometimes. For instance, I am using a system which restricts the number of concurrent jobs to 35. When I...

I am curious... What needs to be done for this issue to be considered "fixed"? I'd happy to work on missing functionality.

at SciPy i learned of [fugue](https://github.com/fugue-project/fugue) which tries to provide a unified API for distributed DataFrames on top of Spark and Dask. it could be a great source of inspiration.

- xref the more recent issue: https://github.com/pandera-dev/pandera/issues/705 which aims to implement a `pandera.xarray` module within `pandera`

Any updates regarding this? A while ago @rabernat mentioned that @dopplershift was potentially interested in working on implementing this feature in xarray in https://github.com/pangeo-data/esgf2xarray/issues/1#issuecomment-470707112 I am interested in helping out...

> Ok, another option would be to add that to [xncml](https://xncml.readthedocs.io/en/latest/index.html) > > > > @andersy005 What do you think ? @huard, I haven't touched the codebase in that repo...