datafusion

datafusion copied to clipboard

## Which issue does this PR close? Close #12518 Also, we need to wait for next `sqlparser` release, so this PR is expected to be draft for a while. ##...

Eason0729

Make generate_function_docs.sh error if there is a function without documentation

1

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/12740 All functions in DataFusion should be documented on the documentation site https://datafusion.apache.org/user-guide/sql/index.html Right now, we rely...

alamb

### Describe the bug Actual memory consumption remains high even if the memory limit is specified ### To Reproduce Compile and run datafusion-cli with: ```sh # /usr/bin/time to measure actual...

2010YOUY01

`generate_series` doesn't respect memory limit

3

### Describe the bug You can trivial cause datafusion to use any amount of memory by simply running ```sql select generate_series(9876543210); ``` Memory management functionality, e.g. [`MemoryPool`](https://docs.rs/datafusion/latest/datafusion/execution/memory_pool/trait.MemoryPool.html) does't seem to...

samuelcolvin

[DISCUSSION] Make DataFusion the fastest engine for querying parquet data in ClickBench

13

### Is your feature request related to a problem or challenge? I am mostly writing this up to record what I think is an ongoing work with @jayzhan211 @Rachelint @korowa...

alamb

Support prepared statement arguments in the LIMIT clause

3

### Is your feature request related to a problem or challenge? DataFusion: v41.0.0 I want to be able to write the following query as a prepared statement: ```sql PREPARE get_N_rand_ints_from_last_run(INT)...

WeCodingNow

Generate GroupByHash output in multiple RecordBatches

18

## Which issue does this PR close? Closes https://github.com/apache/datafusion/issues/9562 If the community thinks this PR is reasonable, I will continue the work: - [ ] 1. Eliminate redundant code -...

JasonLi-cn

Retry to use `Arc<Statistic>` in `PartitionedFile` again

2

## Which issue does this PR close? Closes #11885 ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are there...

Rachelint

## Which issue does this PR close? Closes #12694 ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are there...

hailelagi

CSV can't parse null value for non-string type (i32, i64, float)

1

### Describe the bug As title, I would like to store null value in the csv table but couldn't. ### To Reproduce Write a csv file to `datafusion/core/tests/data/data.csv` with ```csv...

jayzhan211