vscode-java-test icon indicating copy to clipboard operation
vscode-java-test copied to clipboard

Support JUnit5 parallel execution

Open mseele opened this issue 1 year ago • 4 comments

We write more and more test to be able to run in parallel. This works, but vscode sometimes does display the wrong result-status icon in front of the tests. After a (parallel) test run, there should be a green checkbox (or red cross) next to the test name in the test view. However vscode does get confused by the parallel test run and shows only a few result icons and lot's of "not-run" icons next to the (ran) tests. Please see my attached screenshot for further details.

And feel free to reach out for more details or something I can help with this issue.

Bildschirmfoto 2022-08-19 um 11 32 01

mseele avatar Aug 19 '22 09:08 mseele

It's even worse! Running the tests in parallel do hide failures:

Bildschirmfoto 2022-08-19 um 12 54 04

mseele avatar Aug 19 '22 10:08 mseele

Thank you for the feedback. Parallel execution is not supported right now.

jdneo avatar Aug 20 '22 02:08 jdneo

Thank you for the clarification. Is there a timeline to implement this feature or anything I can help with?

mseele avatar Aug 22 '22 13:08 mseele

Sorry no definite timeline yet. But contributions are welcome.

I think the problem happens at https://github.com/microsoft/vscode-java-test/blob/794227efdfe574e4d290db636df7cbd1c57b0786/src/runners/junitRunner/JUnitRunnerResultAnalyzer.ts#L63

The current logic assumes that each time only one test item is treated, which is wrong.

jdneo avatar Aug 23 '22 01:08 jdneo