Andrew Lamb

Blog post about parquet vs custom file formats

12

### Is your feature request related to a problem or challenge? https://x.com/andrewlamb1111/status/1925537738360504663 > ClickBench keeps me convinced that Parquet can be quite fast. There is only a 2.3x performance difference...

Blog post about DataFusion Async / Stream execution model / cancellation

6

### Is your feature request related to a problem or challenge? The use of Rust `async` and `Stream` for execution is not obvious to everyone working with DataFusion and takes...

[EPIC] Complete `datafusion-spark` Spark Compatible Functions

7

### Is your feature request related to a problem or challenge? Many DataFusion users are using DataFusion to execution workloads originally developed for Apache Spark. Examples include - [DataFusion Comet](https://datafusion.apache.org/comet/)...

Improved experience when remote object store URL does not end in `/`

4

### Is your feature request related to a problem or challenge? - part of https://github.com/apache/datafusion/issues/13456 - related to https://github.com/apache/datafusion/issues/16299 I would like to make querying files from remote stores to...

### Is your feature request related to a problem or challenge? The new version of sqlparser has been released: https://crates.io/crates/sqlparser/0.56.0 Datafusion is still on sqlparser 0.55.0: https://github.com/apache/datafusion/blob/9c98b0152f37bf9b8f1f88c4f35a6674647320ce/Cargo.toml#L170-L169 ### Describe the...

Add statistics to ParquetExec for *files* pruned

7

### Is your feature request related to a problem or challenge? - This is a follow on to the feature added by @adriangb in https://github.com/apache/datafusion/pull/16014 @adriangb added the great feature...

`datafusion-cli`: Use correct S3 region if it is not specified

5

### Is your feature request related to a problem or challenge? - Part of https://github.com/apache/datafusion/issues/13456 I would like to make it easy to use datafusion-cli to query files on S3...

[Epic] DataFusion Blogs

4

@pauldix says the recipe for great products is: 1. Write great software ✅ 2. Tell people about it 📖 I immodestly think we already do the great software part in...

Add an example of embedding indexes *inside* a parquet file

7

### Is your feature request related to a problem or challenge? One of the common criticisms of parquet based query systems is that they don't have some particular type of...

I recently gave a talk about using DataFusion to build specialized indexes for querying Parquet: https://www.youtube.com/watch?v=74YsJT1-Rdk I think it would also make a nice blog post on the datafusion site,...