Andrew Lamb

DataFusion serialization doesn't handle `ScalarValue::Dictionary, Binary, LargeBinary, Time64, IntervalMonthDayNano, Struct`

1

**Describe the bug** While updating to the latest and greatest DataFusion pin in IOx (https://github.com/influxdata/influxdb_iox/pull/5672) I got the following error: ``` Error encoding expr as protobuf: Dictionary(Int32, Utf8(\"B\")) is invalid...

Memory Limited GroupBy (Externalized / Spill)

9

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Support Grouping "arbitrarily" large inputs (e.g. when the group by hash table...

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** DataFusion offers sophisticated "filter pushdown" optimizations into `LogicalPlan::TableScan` by passing predicates into...

Write a blog about parquet predicate pushdown

2

I think it would be super valuable to write a blog post about all the work from @thinkharderdev @Ted-Jiang, @tustvold and others to make reading from parquet in DataFusion very...

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** We implement user defined aggregates in IOx called "selector functions" -- to...

In https://github.com/apache/arrow-datafusion/pull/3380 @thinkharderdev added support for evaluating filters during the parquet scan via the RowIndex mechanism 🎉 This feature is currently enabled via a feature flag, which is disabled by...

Make a convenience function to register a single `RecordBatch` as a table from SessionContext

2

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** For testing (and those new to DataFusion) it would be very convenient...

TPC-H Query 6 has a wrong result

7

*Note*: migrated from original JIRA: https://issues.apache.org/jira/browse/ARROW-12218 TPC-H Query 6 gives a wrong result according to the test in the benchmarks. {{TPCH_DATA=[..]/tpch-dbgen cargo test --release}} Query 6 iteration 0 took 6137.1...

Discuss of sqlparser-rs project status / maintenance October 2022

12

I hope this ticket will serve as a place to discuss the current status of the sqlparser-rs project and where the maintainers plan to take it # Background / People...

[Proposal] Combination of arrow-rs and arrow2, deprecation of arrow2 repository

26

This proposal is a response to the seeming desire to unify Rust Arrow development communities going forward and my summary of the discussion on https://github.com/apache/arrow-rs/issues/1176 (specifically https://github.com/apache/arrow-rs/issues/1176#issuecomment-1430883886) . There is...