vscode-codeql icon indicating copy to clipboard operation
vscode-codeql copied to clipboard

Running tests can try to run non-tests as tests

Open alexet opened this issue 2 years ago • 0 comments

Describe the bug When you have a folder that contains both multiple test packs and non-test packs, it will appear as runnable in the UI with the test packs a subpacks. When you run that folder it will also run the non-tests ibnside it as well.

Version CodeQL extension version: 1.6.11 CodeQL CLI version: 2.10.3 Platform: linux x64

To reproduce Open https://github.com/github/codeql-coding-standards/tree/next Run the c folder in the testing pane. See codeql fail to find the extractor for a non-test folder.

Expected behavior

Only to try run the tests as tests.

Additional context

This can be seen by trying to run the c folder on https://github.com/github/codeql-coding-standards/tree/next

I think we either need to pass --strict-test-discovery when running or explicitly pass the set of tests rather than the folder.

alexet avatar Aug 26 '22 17:08 alexet