dask-sql
dask-sql copied to clipboard
Distributed SQL Engine in Python using Dask
**Is your feature request related to a problem? Please describe.** With #588, we have once again consolidated the logic for offsets and limits. Right now, we are computing the two...
There are several places in the code base where Calcite is mentioned in the comments. All of those instances should be remove and replaced with the correlating DataFusion comment. This...
**Is your feature request related to a problem? Please describe.** We currently support more filter operations than the optimizer is giving us. For example for parquet reader we can filter...
**Is your feature request related to a problem? Please describe.** When reading tables from Parquet files the "nullability" of the column should be read from the source parquet file. Currently...
**Is your feature request related to a problem? Please describe.** Certain queries exist that can cause Dask-SQL to produce a logical plan that reads the same table twice. This is...
**Is your feature request related to a problem? Please describe.** We are seeing `str` literals be present in `call.py`, specifically the `ReduceOperation`. Really this shouldn't be happening. A `str` for...
**What happened**: Running tests with pytest causes a segfault in the JVM when calling `c.sql("SELECT * FROM sometable")` on a `Context`. **What you expected to happen**: No segfault :) **Minimal...
Sometimes intead of using a `JOIN`, an [`INTERSECT`](https://www.techonthenet.com/sql/intersect.php) is used to find the overlap in two sets of records: ``` import pandas as pd df_a = pd.DataFrame({'id': [0, 1, 2]})...
**Is your feature request related to a problem? Please describe.** Rename dask_planner.rust Python module to dask_sql.planner **Describe the solution you'd like** Be able to import the Rust module as `dask_sql.planner`...
**Is your feature request related to a problem? Please describe.** `rust_planner` documentation should be built as part of a release. **Describe the solution you'd like** A setup where `cargo doc`...