pitmp-maven-plugin icon indicating copy to clipboard operation
pitmp-maven-plugin copied to clipboard

Add JUnit tests

Open Cael35 opened this issue 7 years ago • 7 comments

There is automated tests but not with JUnit. The idea is to make JUnit tests that run PitMP on dhell and dnoo, using the plugin maven-plugin-testing-harness. Then we can have a meaningfull "coverage". :-)

Cael35 avatar Jun 05 '18 12:06 Cael35

All automated tests files are located in the directory test_dir. First, reproduce the same test suite using JUnit. PIT uses maven-plugin-testing-harness, so have a look at it and maybe we could even use some classes.

Cael35 avatar Aug 03 '18 10:08 Cael35

I may be interested in helping on this issue :)

pedrorijo91 avatar Sep 05 '18 10:09 pedrorijo91

Hi @pedrorijo91,

your help is greatly appreciated. I'll start working on the conversion of the tests to JUnit in the next week and I'll asign to you some tasks about this activity.

Do you agree?

nicolabertazzo avatar Sep 07 '18 07:09 nicolabertazzo

cool! :)

pedrorijo91 avatar Sep 07 '18 12:09 pedrorijo91

Thanks for your help guys ! It would be great to first reproduce the tests executed by verify_pitmp.sh. It runs PitMP on several projects with 2 different configurations. All files can be found in the directory test_dir. Let me know if you have any questions.

Cael35 avatar Sep 10 '18 08:09 Cael35

hey @nicolabertazzo,

do we already have a plan to tackle this?

pedrorijo91 avatar Sep 26 '18 13:09 pedrorijo91

Once #34 will be merged, we can enhance the test suite.
Here are some ideas for the test cases :-)

  • Make at least one test for each property defined in the mojos ('run' for PitMP with Gregor and 'descartes' for PitMP with Descartes)
  • Verify all tests on projects dhell and dnoo
  • Automatically check the result of execution using XML result files (keep reference files validated by hand, and compare the execution file and the reference file)

Cael35 avatar Oct 18 '18 14:10 Cael35