llvm icon indicating copy to clipboard operation
llvm copied to clipboard

[SYCL][CI] Add unit test coverage regression report for runtime

Open alexbatashev opened this issue 3 years ago • 2 comments

Whenever there're changes to sycl/ directory, a separate job will run regression testing on RT unit tests, and print code coverage difference as a comment to Pull Request. Developers are expected not to regress that metric.

alexbatashev avatar Feb 08 '22 06:02 alexbatashev

Filename Function Coverage Line Coverage Region Coverage Branch Coverage
Totals 17.07% (511/2993) 15.26% (3067/20098) 17.92% (1508/8416) 16.29% (817/5014)

bader avatar Feb 08 '22 14:02 bader

@bader hopefully, when this is done (https://github.com/intel/llvm/pull/5358), these numbers are increased to a more or less reasonable value. And yes, the idea is to track this metric in each PR, and to enforce quality of our testing.

alexbatashev avatar Feb 08 '22 14:02 alexbatashev