datafusion-comet icon indicating copy to clipboard operation
datafusion-comet copied to clipboard

[CometFuzz] Show summary of test coverage

Open andygrove opened this issue 2 months ago • 1 comments

What is the problem the feature request solves?

We currently have no visibility into which expressions were successfully tested after running generated queries. It is possible that all queries for a particular expression may have failed both in Spark and Comet because the query was not valid.

Describe the potential solution

Generate a markdown or HTML report summarizing the coverage for each expression

Additional context

No response

andygrove avatar Oct 21 '25 18:10 andygrove

This could also test whether each expression was actually accelerated by Comet or fell back to Spark

andygrove avatar Oct 21 '25 18:10 andygrove