Oleks V

DataFusion 37.0.0 upgrade

2

### What is the problem the feature request solves? Prepare Comet to DataFusion 37.0.0 upgrade ### Describe the potential solution _No response_ ### Additional context Depends on https://github.com/apache/arrow-datafusion/pull/9697

[EPIC] Native execution for Windows functions

1

This should be an extension for Comet supported native function execution. The SQL window builtin function currently is not covered. - [ ] #599 - [ ] #606 - [...

Make modulos with negative float zero compat with other engines

8

### Describe the bug DF returns NaN in modulo query below and is not compliant with major engines: ``` > select 1 % -0.0; +------------------------+ | Int64(1) % Float64(-0) |...

feat: Support IGNORE NULLS only for allowed aggregation functions

1

Currently parser allows to parse queries which IMHO should be failing by unsupported syntax. Like `SELECT COUNT(*) IGNORE NULLS FROM (values (1), (null), (2));` The allowed list for IGNORE NULLS...

Currently parser allows to parse queries which IMHO should be failing by unsupported syntax. Like SELECT COUNT(*) IGNORE NULLS OVER() FROM (values (1), (null), (2)); The allowed list for IGNORE...

## Which issue does this PR close? Closes #826 Closes #605 ## Rationale for this change Document the way to start Comet in cluster mode so the resource manager respects...

Follow up to support IGNORE NULLS for windows functions _Originally posted by @comphead in https://github.com/apache/datafusion-comet/pull/599#discussion_r1659006420_

Test CometDriverPlugin in Kube/Yarn

5

In Comet there is a Spark driver plugin that overrides `spark.executor.memoryOverhead` value to respect native part needed for the Comet. Resource managers like YARN/Kube considers `spark.executor.memoryOverhead` param when containers get...

### What is the problem the feature request solves? It would be nice to make it clearer in the code when we had deep clones and when we were just...

### What is the problem the feature request solves? The Comet has Dockerfile and usually users want to try the Comet within the Kube env. ### Describe the potential solution...