Mutation tests on safety unit tests

[adeebshihadeh]

[mpetkovic96]

@adeebshihadeh Could you provide more information about this issue in general? Which part of the panda repository should be tested?

[maxime-desroches]

Currently using these mutations operators (others are not working correctly):

mutators: [cxx_increment, cxx_decrement, cxx_comparison, cxx_bitwise_assignment, cxx_bitwise, cxx_arithmetic_assignment, cxx_arithmetic]

See this page for a list of all the ops

Here are the current mutations that are not caught by the tests: FAILURES_test_body.txt FAILURES_test_chrysler.txt FAILURES_test_defaults.txt FAILURES_test_elm327.txt FAILURES_test_ford.txt FAILURES_test_gm.txt FAILURES_test_honda.txt FAILURES_test_hyundai.txt FAILURES_test_hyundai_canfd.txt FAILURES_test_mazda.txt FAILURES_test_nissan.txt FAILURES_test_subaru.txt FAILURES_test_subaru_preglobal.txt FAILURES_test_tesla.txt FAILURES_test_toyota.txt FAILURES_test_volkswagen_mqb.txt FAILURES_test_volkswagen_pq.txt