datafusion

datafusion copied to clipboard

### Is your feature request related to a problem or challenge? I am working on a websocket `TableProvider` and initially I went about creating my own `TableProvider` but then after...

matthewmturner

### Is your feature request related to a problem or challenge? After merging PR #10504, a new file [monotonicity.rs](https://github.com/apache/datafusion/blob/main/datafusion/functions/src/math/monotonicity.rs) was introduced. This file contains rules for determining whether the output...

berkaysynnada

Use stabalized aws-sdk and clap versions in `datafusion-cli`

5

## Which issue does this PR close? with the latest changes from the main branch and open a new pull request previous #8681 Closes #. ## Rationale for this change...

satyakommula96

### Is your feature request related to a problem or challenge? I've been reading and learning the TableProvider APIs and have finally gotten around to taking a serious look at...

davisp

### Describe the bug As @tustvold points out, there is a [`column_order` API](https://docs.rs/parquet/latest/parquet/file/metadata/struct.FileMetaData.html#method.column_order) defined in parquet that is currently entirely ignored by DataFusion It is not entirely clear to me...

alamb

Updates the requirements on [itertools](https://github.com/rust-itertools/itertools) to permit the latest version. Changelog Sourced from itertools's changelog. 0.13.0 Breaking Removed implementation of DoubleEndedIterator for ConsTuples (#853) Made MultiProduct fused and fixed on...

dependabot[bot]

### Is your feature request related to a problem or challenge? It is common in databases and other analytic system to have additional external "indexes" (perhaps stored in the "metadata...

alamb

Follow on to https://github.com/apache/datafusion/issues/10482 My (personal) North ⭐ : 1000 projects are built using DataFusion 📈 **It would be great for other contributors to DataFusion who plan non trivial work...

alamb

### Is your feature request related to a problem or challenge? @JayjeetAtGithub @Dandandan @yjshen @ozankabak @sunchao and @viirya wrote and submitted a paper to the [SIGMOD 2024 conference](https://2024.sigmod.org) We need...

alamb

Connection reset by peer on AWS S3 object store.

3

### Describe the bug I'm trying to read 6GB table of compressed NDJSON data from S3. The data is compressed with ZStd with about x100 compression ratio. Files are stored...

Smotrov