robotframework-robocop icon indicating copy to clipboard operation
robotframework-robocop copied to clipboard

Compare results between two Robocop runs

Open bhirsz opened this issue 2 years ago • 1 comments

It would be good to have some way of comparing two Robocop runs ie number of new/fixed issues. It could be special report (--report compare).

Other cli tools usually create special directory (like .pylint or .coverage) and store run results there - which is accessed in 2nd and evaluated in 2nd run.

bhirsz avatar Sep 13 '21 06:09 bhirsz

If we rely on external tools, we can use SARIF results with the sarif tool:

dir>sarif diff .sarif.json .sarif2.json
error level: +0 -0 no changes
warning level: +0 +0
  Number of occurrences 35 -> 34 (-1) for issue "0702 Missing blank space after comment character"
note level: +0 -0 no changes
all levels: +0 +0

bhirsz avatar Jul 25 '22 16:07 bhirsz