BenchmarkDotNet icon indicating copy to clipboard operation
BenchmarkDotNet copied to clipboard

Some of the tests defined in the `BenchmarkDotNet.IntegrationTests.ManualRunning` project failed to run

Open filzrev opened this issue 5 months ago • 0 comments

BenchmarkDotNet.IntegrationTests.ManualRunning test projects seems not be executed on CI. And it need to manually invoke these tests.

But when running test on my environment (with VS Test Explorer). Some tests are failed.

1. LocalNativeAotToolchainTests

Throws following exception.

System.IO.DirectoryNotFoundException : D:\projects\runtime\artifacts\packages\Release\Shipping provided as ilcPackages does NOT exist

It seems to be caused because ilcPath path is hardcoded.

2. MSBuildArgumentTests

Throws following exception.

BenchmarkDotNet.IntegrationTests.Xunit.MisconfiguredEnvironmentException : Failed to build benchmarks because the platform linker not found

It seems not support running tests from VS TestExplorer. And need to set VC++ tools paths.

3. EmptyBenchmarksReportZeroTimeAndAllocated_InProcess 4. EmptyBenchmarksReportZeroTimeAndAllocated_Core 5. DifferentSizedStructsBenchmarksReportsNonZeroTimeAndZeroAllocated_InProcess

Some tests assertions fails with following message.

Actual time was not 0

filzrev avatar Jun 05 '25 04:06 filzrev