datafusion

datafusion copied to clipboard

Blog post for the DataFusion 47, 48, and 49 releases

1

### Is your feature request related to a problem or challenge? - Part of https://github.com/apache/datafusion/issues/14836 ### Describe the solution you'd like Let's tell the world what we have been doing...

alamb

Datafusion 48 Clickbench Q6 and Q0 regression

4

### Describe the bug When upgrading to Datafusion 48 our continous benchmarking infra detected a 25x regression in Q6 and 10x in Q0 of Clickbench. This query was previously answered...

robert3005

Introduce Async User Defined Functions

31

## Which issue does this PR close? - Closes #6518. ## Rationale for this change I have been working with @alamb to implement the functional for the async UDF. -...

goldmedal

## Which issue does this PR close? - Closes #. ## Rationale for this change ## What changes are included in this PR? ## Are these changes tested? ## Are...

rich-t-kid-datadog

Implementation for regex_instr

9

## Which issue does this PR close? - Closes #13009 ## Rationale for this change Implements a regex SQL standard function in datafusion ## What changes are included in this...

nirnayroy

Push Dynamic Join Predicates into Scan ("Sideways Information Passing", etc)

16

### Is your feature request related to a problem or challenge? If we want to make DataFusion the engine of choice for fast OLAP processing, eventually we will need to...

alamb

## Which issue does this PR close? part of #16364 ## Rationale for this change see issue ## What changes are included in this PR? 1. Limit intermediate_batch Size During...

UBarney

Add BloomFilter PhysicalExpr

13

### Is your feature request related to a problem or challenge? Related to #15512 I think this is a first step towards HashJoinExec pushdown. I think we should model that...

adriangb

### Is your feature request related to a problem or challenge? This should work ```diff $ git diff datafusion/sqllogictest/test_files/array.slt diff --git datafusion/sqllogictest/test_files/array.slt datafusion/sqllogictest/test_files/array.slt index a2640fa98..0e5644a89 100644 --- datafusion/sqllogictest/test_files/array.slt +++ datafusion/sqllogictest/test_files/array.slt...

findepi

Prune files during streams and avoid additional pruning if there are no dynamic filters

18

https://github.com/apache/datafusion/pull/16014#issuecomment-2977125894

adriangb