xarray-sql
xarray-sql copied to clipboard
alxmrs
An experiment to query Xarray datasets with SQL
https://arrow.apache.org/docs/python/filesystems.html Like Kerchunk, it should be possible to create a virtual parquet dataset from an existing Zarr store. Here, it would also provide a table-like view of a dense array...
First iteration of the SST demo for #36.
Once #4 exists, consider exploring an integration with DuckDB’s Spatial integration. https://duckdb.org/docs/extensions/spatial.html
https://docs.carto.com/data-and-analysis/analytics-toolbox-for-bigquery/sql-reference/raster https://carto.com/blog/cloud-native-raster-analysis-bigquery It seems like this project and CARTO's advanced toolbox aim to solve similar problems. Some quick thoughts on differences: - Both want to give users the ability to...
It looks like this has been around in some from since 2018! https://docs.xarray.dev/en/stable/generated/xarray.Dataset.to_dask_dataframe.html#xarray.Dataset.to_dask_dataframe On initial impression, this seems like it should reduce the need for this library. I'm still happy...
The new Dask Expressions library was really performant in the recent B(Tr)illion Row challenge. I think it would find a good home here.
https://www.threads.net/@earthlyeducation/post/C4KP3-wxv83 I notice this only goes back until 1980. How bad is the global average sea surface temperature this year compared to years past? I think we could answer this...
See https://dask-sql.readthedocs.io/en/latest/server.html#server
Let's see how effectively we can calculate #36 (in time and compute costs) and add a summary of our findings to the README.