audit-testsuite icon indicating copy to clipboard operation
audit-testsuite copied to clipboard

RFE: filter_exclude search by syscall/key, syncmarker fix, comments

Open rgbriggs opened this issue 4 years ago • 4 comments

  • Add key and syscall to exit list rules.
  • Update 2nd syncmarker search.
  • Add comments to each check.

See: https://github.com/linux-audit/audit-testsuite/issues/58

Signed-off-by: Richard Guy Briggs [email protected]


Rebased on https://github.com/linux-audit/audit-testsuite/pull/96

rgbriggs avatar Mar 10 '21 16:03 rgbriggs

On 2021-03-14 11:54, Paul Moore wrote:

-ok( $result, 0 ); +ok( $result, 0 ); # add msgtype ok?

Please don't do this; the operation which is being checked is the line directly above this one. This is comment noise and it detracts from other comments in the test suite.

This isn't a code comment but rather a failed output comment. This is deliberate since the test output doesn't show the operation being checked and otherwise gives no indication what failed without going in to find the line that failed. This has been discussed, justified and accepted in the past. It is a very simple but helpful debugging tool. The alternative is to use ATS_DEBUG so that it is possible to enable diagnostics, which adds significant overhead to labour and code when in most cases just knowing what failed rather than the more detailed how will help resolve the failure.

git grep "^[ ^I]*ok("

rgbriggs avatar Mar 15 '21 00:03 rgbriggs

"Please don't do this."

pcmoore avatar Mar 15 '21 01:03 pcmoore

Let me add to this, I think it is a good thing to have people look at the test source when the test fails; I actually would encourage that in most cases. This is one of the reasons why I've fought against a lot of the overly verbose output, "debugging" messages, etc.

pcmoore avatar Mar 15 '21 01:03 pcmoore

Hi @rgbriggs, I'm just checking in on this PR; are you planning to make the requested change above?

pcmoore avatar Dec 30 '21 19:12 pcmoore