Andy Grove

icon indicating a website link https://andygrove.io icon indicating an email [email protected]

icon company @Apple icon location Broomfield, CO icon location Apache Arrow & Apache DataFusion PMC Member. Original creator of Apache DataFusion query engine. Author of https://www.howqueryengineswork.com/

Results 657 comments of Andy Grove

chore: Remove NativeBase static initializer (to improve error handling when native lib fails to load)

@parthchandra could you review?

chore: Remove NativeBase static initializer (to improve error handling when native lib fails to load)

@parthchandra @viirya I reimplemented this with a much simpler approach. PTAL when you can.

Plugin can fail to initialize native library and hide the root cause

> is as close to the root cause as possible (and is about as user friendly as a unix error message gets. :) ) That error is fine. The issue...

Plugin can fail to initialize native library and hide the root cause

Here is another related issue that I am currently running into: ``` │ Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.comet.package$ ```

Add support for bloom_filter_agg

> I can take this up if more details are provided :) We need to implement an equivalent of Spark's `org.apache.spark.sql.catalyst.expressions.aggregate.BloomFilterAggregate`.

perf: Apply DataFusion's projection pushdown rule

> Thanks @andygrove Makes sense to me. Would you mind to share how much is the performance benefit? I don't expect it to have much impact, but I am running...

perf: Apply DataFusion's projection pushdown rule

The benchmark results are not very exciting, and the improvements could just be noise. However, there is some correlation with the improvements in q18 and q21 that were noted in...

chore: More refactoring of type checking logic

I have a Spark SQL test failure to resolve: ``` SPARK-47430 Support GROUP BY MapType *** FAILED *** (124 milliseconds) org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in...

chore: More refactoring of type checking logic

Thanks for the reviews @mbutrovich and @parthchandra

Include GLIBC version with provided jars

Thanks for filing the issue @lfdversluis, and thanks for the helpful link, @martin-g. I filed https://github.com/apache/datafusion-comet/issues/2511 for building the official releases with an older version of GLIBC. I will aim...