vscode-codeql
vscode-codeql copied to clipboard
Running tests can try to run non-tests as tests
Describe the bug When you have a folder that contains both multiple test packs and non-test packs, it will appear as runnable in the UI with the test packs a subpacks. When you run that folder it will also run the non-tests ibnside it as well.
Version CodeQL extension version: 1.6.11 CodeQL CLI version: 2.10.3 Platform: linux x64
To reproduce Open https://github.com/github/codeql-coding-standards/tree/next Run the c folder in the testing pane. See codeql fail to find the extractor for a non-test folder.
Expected behavior
Only to try run the tests as tests.
Additional context
This can be seen by trying to run the c folder on https://github.com/github/codeql-coding-standards/tree/next
I think we either need to pass --strict-test-discovery
when running or explicitly pass the set of tests rather than the folder.