openfasttrace icon indicating copy to clipboard operation
openfasttrace copied to clipboard

Scan spec item from test report

Open redcatbear opened this issue 6 years ago • 3 comments

As a quality engineer I want to check whether the test covering a requirement were executed and succeeded in order to make sure that tests not only exist, but are in fact used and come back green.

Implementation Idea

Since #159 we are using JUnit5 as unit testing framework it should be possible to find or write a JUnit5 extension that lets us add the specification item ID to the test name so that it will appear in test reports.

OFT should then scan the test results and correlate them with the tests, allowing for even deeper coverage checks.

redcatbear avatar Oct 30 '18 06:10 redcatbear

@kaklakariada, I think this would be quite an advantage over a lot of existing systems.

redcatbear avatar Oct 30 '18 07:10 redcatbear

Good idea. I propose to use a custom annotation on test methods. This will require an additional importer.

kaklakariada avatar Oct 30 '18 20:10 kaklakariada

Exactly. We then also need a priority mechanism that makes sure that if there are two competing importers for one source, the that is assumed better is tried first.

If that fails to produce any items, we fall back to the next.

redcatbear avatar Oct 30 '18 20:10 redcatbear