Doc: Add an example how to test Comet in K8s against user defined query

Open comphead opened this issue 9 months ago • 2 comments

Originally posted by @comphead in https://github.com/apache/datafusion-comet/pull/1540#discussion_r2001712113

Mar 18 '25 18:03 comphead

Apache Spark also relies on SparkPI example in their documentation https://spark.apache.org/docs/3.5.4/running-on-kubernetes.html

Mar 18 '25 21:03 comphead

Spark-PI example is based on in memory RDD so Comet Scan cannot be tested, we need to prepare our own test case which reads data from local source and check the logs contains to comet plan and execution

Mar 18 '25 21:03 comphead