xarray-sql icon indicating copy to clipboard operation
xarray-sql copied to clipboard

Consider Extending Dask Dataframes to provide missing key features.

Open alxmrs opened this issue 1 year ago • 2 comments

By subclassing ddf, we could provide a few key features to make Qarray better:

  • Centralized Metadata, like df shape / size (#18)
  • MultiIndex indexes, like pandas. These would be critical for efficient search along coordinate axes.

alxmrs avatar Feb 27 '24 06:02 alxmrs

https://docs.dask.org/en/latest/dataframe-extend.html

alxmrs avatar Feb 29 '24 10:02 alxmrs

Consider adopting Julia Signell's MultiIndex in for Dask Dataframes: https://github.com/dask/dask/pull/8153

alxmrs avatar Feb 29 '24 10:02 alxmrs

We've pivoted away from Dask. Closing.

alxmrs avatar Sep 27 '25 19:09 alxmrs