datafusion

datafusion copied to clipboard

## Which issue does this PR close? part of https://github.com/apache/datafusion/issues/11182 ## Rationale for this change There is a distinction between catalog API (the traits) and the provided simple implementations (e.g....

alamb

Break datafusion-catalog code into its own crate

4

### Is your feature request related to a problem or challenge? As we start thinking of adding new catalog support in DataFusion for example, @goldmedal tried to do this for...

alamb

Introduce user defined SQL planner API

1

## Which issue does this PR close? Closes #11168 part of https://github.com/apache/datafusion/issues/10534 TLDR is to make it easier for users to customize sql planning, specifically to handle operator translation ##...

jayzhan211

[draft] Add `LogicalType`, try to support user-defined types

1

## Which issue does this PR close? Closes #7923 Follows up on #8143, which is stale. In the current state the PR is a draft implementation to validate the idea...

notfilippo

docs: add example for custom file format with `COPY TO`

1

## Which issue does this PR close? Closes #11079 ## Rationale for this change Adds an example of for how to `COPY table TO` a custom file format. ## What...

tshauck

## Which issue does this PR close? Closes #11114 ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? Covered by existing...

dharanad

Support `Time` Parquet Data Page Statistics

6

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/10922 We are adding APIs to efficiently convert the data stored in Parquet's "PageIndex" into `ArrayRef`s --...

alamb

Remove special casting of `Min` / `Max` built in `AggregateFunctions`

4

### Is your feature request related to a problem or challenge? Part of https://github.com/apache/datafusion/issues/10943 While trying to port `min` and `max` to UDFs in https://github.com/apache/datafusion/pull/11013, @edmondop found several places where...

alamb

Data set which is much bigger than RAM

4

I'm using Rust, meanwhile I'm new to DataFusion. I need to repartition big dataset which is hundreds of GB. It is stored on S3 as multiple compressed packet files. It...

Smotrov

Document how to test examples in user guide, add some more coverage

3

## Which issue does this PR close? Part of https://github.com/apache/datafusion/issues/11172 and https://github.com/apache/datafusion/issues/1813 ## Rationale for this change I am trying to make the examples easier to find / navigate. Right...

alamb