vscode-cmake-tools icon indicating copy to clipboard operation
vscode-cmake-tools copied to clipboard
verified publisher icon microsoft

[Bug] Clicking "Run Test" to execute filtered tests executes all tests instead

Open ungive opened this issue 11 months ago • 3 comments

Brief Issue Summary

When I filter and execute the filtered tests in the VS Code test explorer using this extension which discovered my GTest tets, the extension (or VS Code?) executes all discovered tests instead of just the ones that are displayed after I applied my filter. In the reproduction example below all 45 tests are executed instead of just the filtered 32 tests.

My suspicion is that this might not be an issue with this extension in particular, but with VS Code. But I wanted to open the issue here first instead of assuming it's a VS Code issue from the start.

Originally this was working fine before and I could click "Run Test" as described below to only execute the filtered tests. But in another project I've just now hit 120 tests and whenever I executed 120 filtered tests at once it just executes 240 tests (exactly double it seems). Whenever I removed tests so that I only have 119 it works again. I tried to reproduce it with 120 tests below, but it just doesn't work at all in a fresh VS Code installation and profile.

CMake Tools Diagnostics

{
  "os": "win32",
  "vscodeVersion": "1.99.0-insider",
  "cmtVersion": "1.21.4",
  "configurations": [
    {
      "folder": "w:\\dev\\tmp\\utility",
      "cmakeVersion": "3.28.0",
      "configured": true,
      "generator": "Visual Studio 17 2022",
      "usesPresets": false,
      "compilers": {}
    }
  ],
  "cpptoolsIntegration": {
    "isReady": false,
    "hasCodeModel": false,
    "activeBuildType": "",
    "buildTypesSeen": [],
    "requests": [],
    "responses": [],
    "partialMatches": [],
    "targetCount": 0,
    "executablesCount": 0,
    "librariesCount": 0,
    "targets": []
  },
  "settings": [
    {
      "communicationMode": "automatic",
      "useCMakePresets": "auto",
      "configureOnOpen": true
    }
  ]
}

Debug Log

[main] Building folder: w:/dev/tmp/utility/build 
[build] Starting build
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\cmake.exe" --build w:/dev/tmp/utility/build --config Debug --target ALL_BUILD -j 16 --
[build] MSBuild-Version 17.9.8+b34f75857 für .NET Framework
[build] 
[build]   gmock_main.vcxproj -> W:\dev\tmp\utility\build\lib\Debug\gmock_main.lib
[build]   benchmark.vcxproj -> W:\dev\tmp\utility\build\third_party\benchmark\src\Debug\benchmark.lib
[build]   ungive_utility_test.vcxproj -> W:\dev\tmp\utility\build\Debug\ungive_utility_test.exe
[driver] Build completed: 00:00:00.600
[build] Build finished with exit code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.Example$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 1: Atomic.Example
[ctest] 1/1 Test #1: Atomic.Example ...................   Passed    0.09 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.10 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.ConstructWithValueDefaultConstructor$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 2: Atomic.ConstructWithValueDefaultConstructor
[ctest] 1/1 Test #2: Atomic.ConstructWithValueDefaultConstructor ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.ConstructWithValueMoveConstructor$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 3: Atomic.ConstructWithValueMoveConstructor
[ctest] 1/1 Test #3: Atomic.ConstructWithValueMoveConstructor ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.ConstructWithValueCopyConstructor$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 4: Atomic.ConstructWithValueCopyConstructor
[ctest] 1/1 Test #4: Atomic.ConstructWithValueCopyConstructor ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.ConstructWithValueInitConstructor$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 5: Atomic.ConstructWithValueInitConstructor
[ctest] 1/1 Test #5: Atomic.ConstructWithValueInitConstructor ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.ConstructWithMultiArgumentValueInitConstructor$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 6: Atomic.ConstructWithMultiArgumentValueInitConstructor
[ctest] 1/1 Test #6: Atomic.ConstructWithMultiArgumentValueInitConstructor ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.ConstructWithCopyConstructor$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 7: Atomic.ConstructWithCopyConstructor
[ctest] 1/1 Test #7: Atomic.ConstructWithCopyConstructor ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.ConstructWithMoveConstructor$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 8: Atomic.ConstructWithMoveConstructor
[ctest] 1/1 Test #8: Atomic.ConstructWithMoveConstructor ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.SetBlocksUntilGetReturnValueIsDestructed$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 9: Atomic.SetBlocksUntilGetReturnValueIsDestructed
[ctest] 1/1 Test #9: Atomic.SetBlocksUntilGetReturnValueIsDestructed ...   Passed    0.12 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.14 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.CopyOfGetReturnValueMakesSetBlockAsWell$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 10: Atomic.CopyOfGetReturnValueMakesSetBlockAsWell
[ctest] 1/1 Test #10: Atomic.CopyOfGetReturnValueMakesSetBlockAsWell ...   Passed    0.13 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.13 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.DestructingLiveValueBeforeGetReturnValueMaintainsInternalValue$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 11: Atomic.DestructingLiveValueBeforeGetReturnValueMaintainsInternalValue
[ctest] 1/1 Test #11: Atomic.DestructingLiveValueBeforeGetReturnValueMaintainsInternalValue ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.GetReturnsChangedValueAfterUpdatingValueWithSet$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 12: Atomic.GetReturnsChangedValueAfterUpdatingValueWithSet
[ctest] 1/1 Test #12: Atomic.GetReturnsChangedValueAfterUpdatingValueWithSet ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.GetValueCannotBeModified$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 13: Atomic.GetValueCannotBeModified
[ctest] 1/1 Test #13: Atomic.GetValueCannotBeModified ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.SetDoesNotBlockWhenGetWasNeverCalled$
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest] Test project W:/dev/tmp/utility/build
[ctest]     Start 14: Atomic.SetDoesNotBlockWhenGetWasNeverCalled
[ctest] 1/1 Test #14: Atomic.SetDoesNotBlockWhenGetWasNeverCalled ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.GetDoesNotBlockWhileSetIsWaiting$
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 15: Atomic.GetDoesNotBlockWhileSetIsWaiting
[ctest] 1/1 Test #15: Atomic.GetDoesNotBlockWhileSetIsWaiting ...   Passed    0.12 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.12 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.SetBlocksLongEnoughWhenGetIsCalledWhileSetIsBlocking$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 16: Atomic.SetBlocksLongEnoughWhenGetIsCalledWhileSetIsBlocking
[ctest] 1/1 Test #16: Atomic.SetBlocksLongEnoughWhenGetIsCalledWhileSetIsBlocking ...   Passed    0.23 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.23 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.SetThrowsWhenGetReturnValueLivesBeyondItsLifetime$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 17: Atomic.SetThrowsWhenGetReturnValueLivesBeyondItsLifetime
[ctest] 1/1 Test #17: Atomic.SetThrowsWhenGetReturnValueLivesBeyondItsLifetime ...   Passed    0.12 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.14 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.LifetimeTrackingCausesDeathWhenGetReturnValueLivesTooLong$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 18: Atomic.LifetimeTrackingCausesDeathWhenGetReturnValueLivesTooLong
[ctest] 1/1 Test #18: Atomic.LifetimeTrackingCausesDeathWhenGetReturnValueLivesTooLong ...   Passed    0.20 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.20 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.LifetimeTrackingCausesDeathWhenMultipleGetsLiveTooLong$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 19: Atomic.LifetimeTrackingCausesDeathWhenMultipleGetsLiveTooLong
[ctest] 1/1 Test #19: Atomic.LifetimeTrackingCausesDeathWhenMultipleGetsLiveTooLong ...   Passed    0.62 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.64 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.SetCallsWatchCallback$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 20: Atomic.SetCallsWatchCallback
[ctest] 1/1 Test #20: Atomic.SetCallsWatchCallback .....   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.WatchIsOnlyCalledWithSuccessfulSetCalls$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 21: Atomic.WatchIsOnlyCalledWithSuccessfulSetCalls
[ctest] 1/1 Test #21: Atomic.WatchIsOnlyCalledWithSuccessfulSetCalls ...   Passed    0.10 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.11 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.ValueTypeIsTheTypeOfTheValue$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 22: Atomic.ValueTypeIsTheTypeOfTheValue
[ctest] 1/1 Test #22: Atomic.ValueTypeIsTheTypeOfTheValue ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.DefaultGetLifetimeIsValuePassedAsTemplateArgument$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 23: Atomic.DefaultGetLifetimeIsValuePassedAsTemplateArgument
[ctest] 1/1 Test #23: Atomic.DefaultGetLifetimeIsValuePassedAsTemplateArgument ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.PassedDefaultGetLifeTimeIsUsedAsLifetimeForGetWithoutArguments$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 24: Atomic.PassedDefaultGetLifeTimeIsUsedAsLifetimeForGetWithoutArguments
[ctest] 1/1 Test #24: Atomic.PassedDefaultGetLifeTimeIsUsedAsLifetimeForGetWithoutArguments ...   Passed    0.19 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.19 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.SetPrioritizesDataFromTheLatestCall$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 25: Atomic.SetPrioritizesDataFromTheLatestCall
[ctest] 1/1 Test #25: Atomic.SetPrioritizesDataFromTheLatestCall ...   Passed    0.12 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.13 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.ContainsDataFromLatestSetCallAfterEachOtherBlockingSetReturned$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 26: Atomic.ContainsDataFromLatestSetCallAfterEachOtherBlockingSetReturned
[ctest] 1/1 Test #26: Atomic.ContainsDataFromLatestSetCallAfterEachOtherBlockingSetReturned ...   Passed    0.12 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.14 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.SetPrioritizesDataFromTheLatestCallWithManyThreads$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest]     Start 27: Atomic.SetPrioritizesDataFromTheLatestCallWithManyThreads
[ctest] 1/1 Test #27: Atomic.SetPrioritizesDataFromTheLatestCallWithManyThreads ...   Passed    0.12 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.13 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.OutdatedAndLatestSetCallsTimeOutAndThrowWhenGetLivesTooLong$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 28: Atomic.OutdatedAndLatestSetCallsTimeOutAndThrowWhenGetLivesTooLong
[ctest] 1/1 Test #28: Atomic.OutdatedAndLatestSetCallsTimeOutAndThrowWhenGetLivesTooLong ...   Passed    0.16 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.18 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.CodePathNoSetDelayOtherLatest$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 29: Atomic.CodePathNoSetDelayOtherLatest
[ctest] 1/1 Test #29: Atomic.CodePathNoSetDelayOtherLatest ...   Passed    0.33 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.35 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.GetReturnValueDestructorDoesNotExecuteWhenAtomicIsDestructed$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 30: Atomic.GetReturnValueDestructorDoesNotExecuteWhenAtomicIsDestructed
[ctest] 1/1 Test #30: Atomic.GetReturnValueDestructorDoesNotExecuteWhenAtomicIsDestructed ...   Passed    0.32 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.34 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.NoStaticAssertWhenPassingCopyConstructedValueToSetWhileLockingGet$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 31: Atomic.NoStaticAssertWhenPassingCopyConstructedValueToSetWhileLockingGet
[ctest] 1/1 Test #31: Atomic.NoStaticAssertWhenPassingCopyConstructedValueToSetWhileLockingGet ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^Atomic\.SetGetRaceTest$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 32: Atomic.SetGetRaceTest
[ctest] 1/1 Test #32: Atomic.SetGetRaceTest ............   Passed    1.65 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   1.66 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^AtomicZeroCounter\.StopBlocksUntilCounterIsDecrementedToZero$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 33: AtomicZeroCounter.StopBlocksUntilCounterIsDecrementedToZero
[ctest] 1/1 Test #33: AtomicZeroCounter.StopBlocksUntilCounterIsDecrementedToZero ...   Passed    0.17 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.18 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^AtomicZeroCounter\.StopReturnsImmediatelyWhenCounterIsAtZero$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 34: AtomicZeroCounter.StopReturnsImmediatelyWhenCounterIsAtZero
[ctest] 1/1 Test #34: AtomicZeroCounter.StopReturnsImmediatelyWhenCounterIsAtZero ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^AtomicZeroCounter\.IncrementingAfterStopFails$
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest] Test project W:/dev/tmp/utility/build
[ctest]     Start 35: AtomicZeroCounter.IncrementingAfterStopFails
[ctest] 1/1 Test #35: AtomicZeroCounter.IncrementingAfterStopFails ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^AtomicZeroCounter\.IncrReturnsOldValue$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 36: AtomicZeroCounter.IncrReturnsOldValue
[ctest] 1/1 Test #36: AtomicZeroCounter.IncrReturnsOldValue ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^AtomicZeroCounter\.DecrAfterStopReturnsPositiveValue$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 37: AtomicZeroCounter.DecrAfterStopReturnsPositiveValue
[ctest] 1/1 Test #37: AtomicZeroCounter.DecrAfterStopReturnsPositiveValue ...   Passed    0.05 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.05 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^AtomicZeroCounter\.LoadReturnsCurrentValue$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 38: AtomicZeroCounter.LoadReturnsCurrentValue
[ctest] 1/1 Test #38: AtomicZeroCounter.LoadReturnsCurrentValue ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^AtomicZeroCounter\.ThrowsWhenStopIsCalledTwice$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 39: AtomicZeroCounter.ThrowsWhenStopIsCalledTwice
[ctest] 1/1 Test #39: AtomicZeroCounter.ThrowsWhenStopIsCalledTwice ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^counter_guard\.EvaluatesToTrueWhenIncrementSucceeded$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 40: counter_guard.EvaluatesToTrueWhenIncrementSucceeded
[ctest] 1/1 Test #40: counter_guard.EvaluatesToTrueWhenIncrementSucceeded ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^counter_guard\.EvaluatesToFalseWhenIncrementFailed$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 41: counter_guard.EvaluatesToFalseWhenIncrementFailed
[ctest] 1/1 Test #41: counter_guard.EvaluatesToFalseWhenIncrementFailed ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^counter_guard\.DoesNotDecrementWhenIncrementFailed$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 42: counter_guard.DoesNotDecrementWhenIncrementFailed
[ctest] 1/1 Test #42: counter_guard.DoesNotDecrementWhenIncrementFailed ...   Passed    0.02 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.02 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^counter_guard\.DecrementsAfterDestruction$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 43: counter_guard.DecrementsAfterDestruction
[ctest] 1/1 Test #43: counter_guard.DecrementsAfterDestruction ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^counter_guard\.ResultReturnsTheIncrementReturnValue$
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Test project W:/dev/tmp/utility/build
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest]     Start 44: counter_guard.ResultReturnsTheIncrementReturnValue
[ctest] 1/1 Test #44: counter_guard.ResultReturnsTheIncrementReturnValue ...   Passed    0.01 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   0.01 sec
[ctest] CTest finished with return code 0
[proc] Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^ungive_utility_test$
[ctest]    Site: 
[ctest]    Build name: (empty)
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest] Cannot find file: W:/dev/tmp/utility/build/DartConfiguration.tcl
[ctest] Test project W:/dev/tmp/utility/build
[ctest]     Start 45: ungive_utility_test
[ctest] 1/1 Test #45: ungive_utility_test ..............   Passed    4.44 sec
[ctest] 
[ctest] 100% tests passed, 0 tests failed out of 1
[ctest] 
[ctest] Total Test time (real) =   4.45 sec
[ctest] CTest finished with return code 0

Additional Information

Reproduction steps:

  • Create a new VS Code profile (Profiles: New Profile...)
  • Install Pre-Release of CMake Tools
  • git clone https://github.com/ungive/utility
  • git checkout vscode-cmake-tools-bug
  • git submodule update --init --recursive
  • Make sure you have a C++ compiler installed (I'm on Windows using MSVC with Visual Studio 17 2022)
  • Configure and build the project in the CMake screen
  • Go to the test explorer and click "Refresh Tests"
  • Enter "Atomic." (with the period) in the filter text bar
  • Observe that tests are filtered
  • Click on the play button ("Run Test") under the "utility" group where you find 32 tests under
  • The loading icon shows it executes 45 tests (all tests)
  • The Output window contains test results for e.g. "counter_guard.DoesNotDecrementWhenIncrementFailed" which is clearly filtered out

Not sure if this is an extension issue or VS Code issue, but the fact the output window says "Executing command: "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin\ctest.exe" -j16 -C Debug -T test --output-on-failure -R ^counter_guard.ResultReturnsTheIncrementReturnValue$" suggests to me that it's the extensions fault (I could be wrong though).

ungive avatar Mar 11 '25 16:03 ungive

Hi @ungive , thanks for reporting issue here! Reproduced this on CMake tool v1.21.5(pre-release) follow above reproduction steps. Image

@gcampbell-msft FYI

Amy-Li03 avatar Mar 12 '25 08:03 Amy-Li03

@gcampbell-msft the problem seems to come from request.include line 986 of ctest.ts file. The include member is undefined whereas its exclude member contains effectively all the tests that should not be run.

Is it our responsibility to process the TestItem collection to remove the excluded tests?

hippo91 avatar Mar 23 '25 14:03 hippo91

It sounds like we should be utilizing both the include and the exclude fields to determine which tests, since the include seems to be undefined. We'll investigate.

gcampbell-msft avatar Mar 28 '25 13:03 gcampbell-msft

Looked over and merged @hippo91's fix! Thanks for looking into this @ungive!

hanniavalera avatar Sep 26 '25 18:09 hanniavalera

We verified this issue on VS Code 1.104.2 + CMake tools 1.22.11 version, this issue has been fixed. Image Image

yanghhhhhhh avatar Sep 30 '25 06:09 yanghhhhhhh