datafusion

datafusion copied to clipboard

Add example for writing a `FileFormat`

4

### Is your feature request related to a problem or challenge? Now that @devinjdangelo has added better support for user defined file formats (see https://github.com/apache/datafusion/pull/11060) We have an example of...

alamb

Move min and max to user defined aggregate function

18

## Which issue does this PR close? Closes #10943 . - [x] Sliding window accumulator for min and max ## Rationale for this change ## What changes are included in...

edmondop

Allow casting durations to different timeunits

1

### Is your feature request related to a problem or challenge? I would like to be able to cast a duration to a different timeunit. Current behavior: ``` DataFusion CLI...

simonvandel

Running tests uses 50.1GB on Ubuntu

5

### Describe the bug I just cloned datafusion and tried `cargo t` on my ubuntu desktop, to check things were working properly. It crashed. I restarted, and it seems datafusion...

samuelcolvin

Specialized / Pre-compiled / Prepared ScalarUDFs

12

### Is your feature request related to a problem or challenge? Currently, scalar UDF functions can not be "specialized" ```select SELECT * FROM t where my_matcher(t.column, '[a-z].*'); ``` What happens...

alamb

build(deps): update pyo3 requirement from 0.21.0 to 0.22.0

1

Updates the requirements on [pyo3](https://github.com/pyo3/pyo3) to permit the latest version. Release notes Sourced from pyo3's releases. PyO3 0.21.2 This release contains some fixes to compile-time edge cases for the PyO3...

dependabot[bot]

Verify if DISTINCT supports all types, incl binary, complex, etc

4

Wondering if DISTINCT supports all types, incl binary, complex, etc? if its not we should be mentioning it in the doc, and double check it returns a respective error instead...

alamb

short-circuited expression should be evaluated one by one

5

### Describe the bug In our current implementation, the sub-expression within the short-circuited expression is always evaluated even when they don't need to be evaluated. We first evaluate all expressions...

haohuaijin

Support Map as a ScalarValue

4

### Is your feature request related to a problem or challenge? ScalarValue does not currently support Maps, see e.g. https://github.com/apache/datafusion/issues/8262#issuecomment-1852700799. https://github.com/apache/datafusion/issues/6485 is probably related as well, though I'm not 100%...

Blizzara

Support Gap Filling on Time Series Data

21

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** A common use case when working with time series data is to...

wolffcm