llvm
llvm copied to clipboard
[SYCL][CI] Add unit test coverage regression report for runtime
Whenever there're changes to sycl/ directory, a separate job will run regression testing on RT unit tests, and print code coverage difference as a comment to Pull Request. Developers are expected not to regress that metric.
| Filename | Function Coverage | Line Coverage | Region Coverage | Branch Coverage |
|---|---|---|---|---|
| Totals | 17.07% (511/2993) | 15.26% (3067/20098) | 17.92% (1508/8416) | 16.29% (817/5014) |
@bader hopefully, when this is done (https://github.com/intel/llvm/pull/5358), these numbers are increased to a more or less reasonable value. And yes, the idea is to track this metric in each PR, and to enforce quality of our testing.