dd-trace-dotnet icon indicating copy to clipboard operation
dd-trace-dotnet copied to clipboard

[DRAFT] Show error info in tests

Open NachoEchevarria opened this issue 6 months ago • 3 comments

Summary of changes

Reason for change

Implementation details

Test coverage

Other details

NachoEchevarria avatar May 26 '25 14:05 NachoEchevarria

Datadog Report

Branch report: nacho/FailInfoMetastruct Commit report: 2e61592 Test service: dd-trace-dotnet

:x: 1298 Failed (1 Known Flaky), 249775 Passed, 2261 Skipped, 17h 41m 55.25s Total Time

:x: Failed Tests (1298)

This report shows up to 5 failed tests.

  • TestApiSecurityScan - Datadog.Trace.Security.IntegrationTests.ApiSecurity.AspNetCore5ApiSecurityDisabled - Details

    Expand for error
    etaStructByteArrayToObject is null, this is likely because the appsec meta struct is not available in the test application. Please ensure that the test application is configured to use the AppSec meta struct.
    
  • TestApiSecurityScan - Datadog.Trace.Security.IntegrationTests.ApiSecurity.AspNetCore5ApiSecurityDisabled - Details

    Expand for error
    etaStructByteArrayToObject is null, this is likely because the appsec meta struct is not available in the test application. Please ensure that the test application is configured to use the AppSec meta struct.
    
  • TestApiSecurityScan - Datadog.Trace.Security.IntegrationTests.ApiSecurity.AspNetCore5ApiSecurityDisabled - Details

    Expand for error
    etaStructByteArrayToObject is null, this is likely because the appsec meta struct is not available in the test application. Please ensure that the test application is configured to use the AppSec meta struct.
    
  • TestApiSecurityScan - Datadog.Trace.Security.IntegrationTests.ApiSecurity.AspNetCore5ApiSecurityDisabled - Details

    Expand for error
    etaStructByteArrayToObject is null, this is likely because the appsec meta struct is not available in the test application. Please ensure that the test application is configured to use the AppSec meta struct.
    
  • TestApiSecurityScan - Datadog.Trace.Security.IntegrationTests.ApiSecurity.AspNetCore5ApiSecurityDisabled - Details

    Expand for error
    etaStructByteArrayToObject is null, this is likely because the appsec meta struct is not available in the test application. Please ensure that the test application is configured to use the AppSec meta struct.
    

Execution-Time Benchmarks Report :stopwatch:

Execution-time results for samples comparing the following branches/commits:

Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:

  • Welch test with statistical test for significance of 5%
  • Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (7006) - mean (68ms)  : 65, 72
     .   : milestone, 68,
    master - mean (68ms)  : 65, 71
     .   : milestone, 68,

    section CallTarget+Inlining+NGEN
    This PR (7006) - mean (1,010ms)  : 982, 1037
     .   : milestone, 1010,
    master - mean (1,005ms)  : 983, 1027
     .   : milestone, 1005,

gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (7006) - mean (102ms)  : 100, 105
     .   : milestone, 102,
    master - mean (102ms)  : 99, 104
     .   : milestone, 102,

    section CallTarget+Inlining+NGEN
    This PR (7006) - mean (695ms)  : 676, 713
     .   : milestone, 695,
    master - mean (695ms)  : 676, 714
     .   : milestone, 695,

gantt
    title Execution time (ms) FakeDbCommand (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (7006) - mean (89ms)  : 88, 91
     .   : milestone, 89,
    master - mean (89ms)  : 87, 90
     .   : milestone, 89,

    section CallTarget+Inlining+NGEN
    This PR (7006) - mean (656ms)  : 632, 680
     .   : milestone, 656,
    master - mean (652ms)  : 629, 675
     .   : milestone, 652,

gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (7006) - mean (189ms)  : 185, 192
     .   : milestone, 189,
    master - mean (189ms)  : 185, 194
     .   : milestone, 189,

    section CallTarget+Inlining+NGEN
    This PR (7006) - mean (1,113ms)  : 1085, 1141
     .   : milestone, 1113,
    master - mean (1,105ms)  : 1080, 1130
     .   : milestone, 1105,

gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (7006) - mean (268ms)  : 264, 272
     .   : milestone, 268,
    master - mean (269ms)  : 264, 273
     .   : milestone, 269,

    section CallTarget+Inlining+NGEN
    This PR (7006) - mean (878ms)  : 848, 908
     .   : milestone, 878,
    master - mean (881ms)  : 841, 920
     .   : milestone, 881,

gantt
    title Execution time (ms) HttpMessageHandler (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (7006) - mean (260ms)  : 256, 264
     .   : milestone, 260,
    master - mean (261ms)  : 257, 264
     .   : milestone, 261,

    section CallTarget+Inlining+NGEN
    This PR (7006) - mean (869ms)  : 840, 898
     .   : milestone, 869,
    master - mean (866ms)  : 828, 905
     .   : milestone, 866,

andrewlock avatar May 26 '25 14:05 andrewlock

Benchmarks

Benchmarks Report for benchmark platform :snail:

Benchmarks for #7006 compared to master:

  • All benchmarks have the same speed
  • 2 benchmarks have fewer allocations
  • 5 benchmarks have more allocations

The following thresholds were used for comparing the benchmark speeds:

  • Mann–Whitney U test with statistical test for significance of 5%
  • Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks.Trace.ActivityBenchmark - Same speed :heavy_check_mark: More allocations :warning:

More allocations :warning: in #7006

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.ActivityBenchmark.StartStopWithChild‑net472 6.06 KB 6.19 KB 132 B 2.18%

Fewer allocations :tada: in #7006

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.ActivityBenchmark.StartStopWithChild‑netcoreapp3.1 5.77 KB 5.74 KB -33 B -0.57%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartStopWithChild net6.0 10.9μs 58.3ns 314ns 0 0 0 5.55 KB
master StartStopWithChild netcoreapp3.1 13.6μs 70.8ns 332ns 0 0 0 5.77 KB
master StartStopWithChild net472 22.3μs 125ns 820ns 0.898 0.224 0 6.06 KB
#7006 StartStopWithChild net6.0 10.7μs 58.8ns 348ns 0 0 0 5.55 KB
#7006 StartStopWithChild netcoreapp3.1 13.4μs 69ns 324ns 0 0 0 5.74 KB
#7006 StartStopWithChild net472 22.3μs 123ns 805ns 0.911 0.228 0 6.19 KB
Benchmarks.Trace.AgentWriterBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 941μs 147ns 570ns 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 1.02ms 154ns 578ns 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces net472 1.23ms 55.7ns 208ns 0 0 0 3.31 KB
#7006 WriteAndFlushEnrichedTraces net6.0 947μs 233ns 902ns 0 0 0 2.7 KB
#7006 WriteAndFlushEnrichedTraces netcoreapp3.1 1.03ms 466ns 1.81μs 0 0 0 2.7 KB
#7006 WriteAndFlushEnrichedTraces net472 1.22ms 353ns 1.37μs 0 0 0 3.31 KB
Benchmarks.Trace.Asm.AppSecBodyBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master AllCycleSimpleBody net6.0 327μs 292ns 1.09μs 0 0 0 197.06 KB
master AllCycleSimpleBody netcoreapp3.1 477μs 510ns 1.98μs 0 0 0 204.77 KB
master AllCycleSimpleBody net472 435μs 111ns 429ns 36.6 2.16 0 236.35 KB
master AllCycleMoreComplexBody net6.0 345μs 1.68μs 6.93μs 0 0 0 200.56 KB
master AllCycleMoreComplexBody netcoreapp3.1 497μs 1.92μs 7.42μs 0 0 0 208.18 KB
master AllCycleMoreComplexBody net472 445μs 173ns 647ns 36.6 2.16 0 239.87 KB
master ObjectExtractorSimpleBody net6.0 316ns 1.72ns 8.91ns 0 0 0 280 B
master ObjectExtractorSimpleBody netcoreapp3.1 390ns 2.17ns 13.9ns 0 0 0 272 B
master ObjectExtractorSimpleBody net472 302ns 0.0346ns 0.129ns 0.044 0 0 281 B
master ObjectExtractorMoreComplexBody net6.0 6.26μs 30ns 120ns 0 0 0 3.78 KB
master ObjectExtractorMoreComplexBody netcoreapp3.1 7.68μs 23.7ns 91.7ns 0 0 0 3.69 KB
master ObjectExtractorMoreComplexBody net472 6.7μs 3.07ns 11.9ns 0.602 0 0 3.8 KB
#7006 AllCycleSimpleBody net6.0 336μs 553ns 2.14μs 0 0 0 197.06 KB
#7006 AllCycleSimpleBody netcoreapp3.1 494μs 1.92μs 7.44μs 0 0 0 204.77 KB
#7006 AllCycleSimpleBody net472 436μs 127ns 492ns 36.6 2.16 0 236.35 KB
#7006 AllCycleMoreComplexBody net6.0 333μs 1.68μs 7.68μs 0 0 0 200.56 KB
#7006 AllCycleMoreComplexBody netcoreapp3.1 501μs 2.26μs 8.75μs 0 0 0 208.18 KB
#7006 AllCycleMoreComplexBody net472 448μs 125ns 482ns 37.9 2.23 0 239.88 KB
#7006 ObjectExtractorSimpleBody net6.0 309ns 1.51ns 7.41ns 0 0 0 280 B
#7006 ObjectExtractorSimpleBody netcoreapp3.1 405ns 1.72ns 6.65ns 0 0 0 272 B
#7006 ObjectExtractorSimpleBody net472 303ns 0.0478ns 0.185ns 0.0441 0 0 281 B
#7006 ObjectExtractorMoreComplexBody net6.0 6.32μs 1.86ns 7.22ns 0 0 0 3.78 KB
#7006 ObjectExtractorMoreComplexBody netcoreapp3.1 7.75μs 38.6ns 159ns 0 0 0 3.69 KB
#7006 ObjectExtractorMoreComplexBody net472 6.74μs 2.35ns 8.81ns 0.573 0 0 3.8 KB
Benchmarks.Trace.Asm.AppSecEncoderBenchmark - Unknown :shrug: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EncodeArgs net6.0 N/A N/A N/A NaN NaN NaN 0 b
master EncodeArgs netcoreapp3.1 N/A N/A N/A NaN NaN NaN 0 b
master EncodeArgs net472 N/A N/A N/A NaN NaN NaN 0 b
master EncodeLegacyArgs net6.0 N/A N/A N/A NaN NaN NaN 0 b
master EncodeLegacyArgs netcoreapp3.1 N/A N/A N/A NaN NaN NaN 0 b
master EncodeLegacyArgs net472 N/A N/A N/A NaN NaN NaN 0 b
#7006 EncodeArgs net6.0 N/A N/A N/A NaN NaN NaN 0 b
#7006 EncodeArgs netcoreapp3.1 N/A N/A N/A NaN NaN NaN 0 b
#7006 EncodeArgs net472 N/A N/A N/A NaN NaN NaN 0 b
#7006 EncodeLegacyArgs net6.0 N/A N/A N/A NaN NaN NaN 0 b
#7006 EncodeLegacyArgs netcoreapp3.1 N/A N/A N/A NaN NaN NaN 0 b
#7006 EncodeLegacyArgs net472 N/A N/A N/A NaN NaN NaN 0 b
Benchmarks.Trace.Asm.AppSecWafBenchmark - Unknown :shrug: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunWafRealisticBenchmark net6.0 N/A N/A N/A NaN NaN NaN 0 b
master RunWafRealisticBenchmark netcoreapp3.1 N/A N/A N/A NaN NaN NaN 0 b
master RunWafRealisticBenchmark net472 N/A N/A N/A NaN NaN NaN 0 b
master RunWafRealisticBenchmarkWithAttack net6.0 N/A N/A N/A NaN NaN NaN 0 b
master RunWafRealisticBenchmarkWithAttack netcoreapp3.1 N/A N/A N/A NaN NaN NaN 0 b
master RunWafRealisticBenchmarkWithAttack net472 N/A N/A N/A NaN NaN NaN 0 b
#7006 RunWafRealisticBenchmark net6.0 N/A N/A N/A NaN NaN NaN 0 b
#7006 RunWafRealisticBenchmark netcoreapp3.1 N/A N/A N/A NaN NaN NaN 0 b
#7006 RunWafRealisticBenchmark net472 N/A N/A N/A NaN NaN NaN 0 b
#7006 RunWafRealisticBenchmarkWithAttack net6.0 N/A N/A N/A NaN NaN NaN 0 b
#7006 RunWafRealisticBenchmarkWithAttack netcoreapp3.1 N/A N/A N/A NaN NaN NaN 0 b
#7006 RunWafRealisticBenchmarkWithAttack net472 N/A N/A N/A NaN NaN NaN 0 b
Benchmarks.Trace.AspNetCoreBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendRequest net6.0 61.8μs 44.7ns 161ns 0 0 0 14.53 KB
master SendRequest netcoreapp3.1 71.2μs 345ns 1.83μs 0 0 0 17.43 KB
master SendRequest net472 0.0215ns 0.00302ns 0.0117ns 0 0 0 0 b
#7006 SendRequest net6.0 61.2μs 40.9ns 158ns 0 0 0 14.53 KB
#7006 SendRequest netcoreapp3.1 71.1μs 219ns 877ns 0 0 0 17.42 KB
#7006 SendRequest net472 0.00542ns 0.00197ns 0.00761ns 0 0 0 0 b
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed :heavy_check_mark: More allocations :warning:

More allocations :warning: in #7006

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑net472 55.51 KB 56.25 KB 739 B 1.33%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 716μs 4.16μs 34.8μs 0 0 0 41.68 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 679μs 3.76μs 24.4μs 0 0 0 41.9 KB
master WriteAndFlushEnrichedTraces net472 950μs 4.24μs 16.4μs 4.46 0 0 55.51 KB
#7006 WriteAndFlushEnrichedTraces net6.0 681μs 391ns 1.51μs 0 0 0 41.8 KB
#7006 WriteAndFlushEnrichedTraces netcoreapp3.1 649μs 580ns 2.09μs 0 0 0 41.96 KB
#7006 WriteAndFlushEnrichedTraces net472 903μs 4.56μs 26.2μs 8.33 0 0 56.25 KB
Benchmarks.Trace.DbCommandBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteNonQuery net6.0 1.92μs 8.09ns 31.3ns 0 0 0 1.03 KB
master ExecuteNonQuery netcoreapp3.1 2.6μs 9.32ns 36.1ns 0 0 0 1.02 KB
master ExecuteNonQuery net472 2.75μs 4.77ns 18.5ns 0.149 0.0135 0 995 B
#7006 ExecuteNonQuery net6.0 1.97μs 2.85ns 10.3ns 0 0 0 1.03 KB
#7006 ExecuteNonQuery netcoreapp3.1 2.53μs 6.37ns 24.7ns 0 0 0 1.02 KB
#7006 ExecuteNonQuery net472 2.7μs 2.85ns 11ns 0.147 0.0134 0 995 B
Benchmarks.Trace.ElasticsearchBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master CallElasticsearch net6.0 1.79μs 2.81ns 10.9ns 0 0 0 1.04 KB
master CallElasticsearch netcoreapp3.1 2.27μs 1.02ns 3.68ns 0 0 0 1.04 KB
master CallElasticsearch net472 3.46μs 3.18ns 12.3ns 0.156 0 0 1.05 KB
master CallElasticsearchAsync net6.0 1.85μs 7.84ns 30.3ns 0 0 0 1.02 KB
master CallElasticsearchAsync netcoreapp3.1 2.33μs 9.62ns 37.3ns 0 0 0 1.09 KB
master CallElasticsearchAsync net472 3.64μs 3.92ns 15.2ns 0.163 0 0 1.11 KB
#7006 CallElasticsearch net6.0 1.72μs 6.58ns 25.5ns 0 0 0 1.04 KB
#7006 CallElasticsearch netcoreapp3.1 2.28μs 11.2ns 48.8ns 0 0 0 1.04 KB
#7006 CallElasticsearch net472 3.43μs 5.75ns 22.3ns 0.154 0 0 1.05 KB
#7006 CallElasticsearchAsync net6.0 1.79μs 8.98ns 38.1ns 0 0 0 1.02 KB
#7006 CallElasticsearchAsync netcoreapp3.1 2.42μs 6.12ns 23.7ns 0 0 0 1.09 KB
#7006 CallElasticsearchAsync net472 3.63μs 5.53ns 21.4ns 0.164 0 0 1.11 KB
Benchmarks.Trace.GraphQLBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteAsync net6.0 1.86μs 9.65ns 46.3ns 0 0 0 960 B
master ExecuteAsync netcoreapp3.1 2.24μs 8.55ns 33.1ns 0 0 0 960 B
master ExecuteAsync net472 2.57μs 0.675ns 2.61ns 0.14 0 0 923 B
#7006 ExecuteAsync net6.0 1.77μs 0.537ns 2.08ns 0 0 0 960 B
#7006 ExecuteAsync netcoreapp3.1 2.32μs 5.98ns 22.4ns 0 0 0 960 B
#7006 ExecuteAsync net472 2.51μs 1.41ns 4.87ns 0.14 0 0 923 B
Benchmarks.Trace.HttpClientBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendAsync net6.0 6.66μs 1.84ns 7.13ns 0 0 0 2.37 KB
master SendAsync netcoreapp3.1 8.64μs 11.7ns 45.4ns 0 0 0 2.9 KB
master SendAsync net472 12.4μs 8.57ns 33.2ns 0.493 0 0 3.19 KB
#7006 SendAsync net6.0 6.8μs 21.7ns 78.1ns 0 0 0 2.37 KB
#7006 SendAsync netcoreapp3.1 8.46μs 12.3ns 44.2ns 0 0 0 2.9 KB
#7006 SendAsync net472 12.2μs 11.8ns 45.8ns 0.482 0 0 3.19 KB
Benchmarks.Trace.Iast.StringAspectsBenchmark - Same speed :heavy_check_mark: More allocations :warning:

More allocations :warning: in #7006

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1 256.72 KB 271.78 KB 15.06 KB 5.86%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net472 278.53 KB 284.7 KB 6.18 KB 2.22%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑netcoreapp3.1 42.64 KB 42.9 KB 264 B 0.62%

Fewer allocations :tada: in #7006

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net6.0 278.36 KB 256.75 KB -21.61 KB -7.76%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StringConcatBenchmark net6.0 41.7μs 224ns 1.19μs 0 0 0 43.1 KB
master StringConcatBenchmark netcoreapp3.1 50.7μs 277ns 1.82μs 0 0 0 42.64 KB
master StringConcatBenchmark net472 56.8μs 281ns 1.19μs 0 0 0 57.34 KB
master StringConcatAspectBenchmark net6.0 477μs 1.77μs 6.14μs 0 0 0 278.36 KB
master StringConcatAspectBenchmark netcoreapp3.1 524μs 2.6μs 11μs 0 0 0 256.72 KB
master StringConcatAspectBenchmark net472 405μs 2.34μs 17.8μs 0 0 0 278.53 KB
#7006 StringConcatBenchmark net6.0 44.8μs 190ns 659ns 0 0 0 43.1 KB
#7006 StringConcatBenchmark netcoreapp3.1 49.3μs 274ns 1.69μs 0 0 0 42.9 KB
#7006 StringConcatBenchmark net472 57.5μs 104ns 390ns 0 0 0 57.34 KB
#7006 StringConcatAspectBenchmark net6.0 460μs 2.11μs 7.89μs 0 0 0 256.75 KB
#7006 StringConcatAspectBenchmark netcoreapp3.1 515μs 1.67μs 6.02μs 0 0 0 271.78 KB
#7006 StringConcatAspectBenchmark net472 412μs 2.09μs 9.82μs 0 0 0 284.7 KB
Benchmarks.Trace.ILoggerBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 2.59μs 1.18ns 4.25ns 0 0 0 1.76 KB
master EnrichedLog netcoreapp3.1 3.51μs 14.9ns 57.8ns 0 0 0 1.76 KB
master EnrichedLog net472 4.01μs 3.66ns 13.7ns 0.258 0 0 1.69 KB
#7006 EnrichedLog net6.0 2.61μs 1.19ns 4.46ns 0 0 0 1.76 KB
#7006 EnrichedLog netcoreapp3.1 3.46μs 1.38ns 5.34ns 0 0 0 1.76 KB
#7006 EnrichedLog net472 4.13μs 2.92ns 11.3ns 0.249 0 0 1.69 KB
Benchmarks.Trace.Log4netBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 125μs 85.3ns 295ns 0 0 0 4.37 KB
master EnrichedLog netcoreapp3.1 127μs 98.9ns 370ns 0 0 0 4.37 KB
master EnrichedLog net472 166μs 136ns 508ns 0 0 0 4.57 KB
#7006 EnrichedLog net6.0 124μs 43.2ns 156ns 0 0 0 4.37 KB
#7006 EnrichedLog netcoreapp3.1 126μs 39.5ns 148ns 0 0 0 4.37 KB
#7006 EnrichedLog net472 167μs 42.7ns 165ns 0 0 0 4.57 KB
Benchmarks.Trace.NLogBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 4.88μs 3.52ns 13.6ns 0 0 0 2.32 KB
master EnrichedLog netcoreapp3.1 6.84μs 9.08ns 35.2ns 0 0 0 2.32 KB
master EnrichedLog net472 7.3μs 12.3ns 47.8ns 0.327 0 0 2.14 KB
#7006 EnrichedLog net6.0 4.99μs 21.4ns 90.8ns 0 0 0 2.32 KB
#7006 EnrichedLog netcoreapp3.1 6.59μs 12.1ns 46.8ns 0 0 0 2.32 KB
#7006 EnrichedLog net472 7.42μs 5.86ns 22.7ns 0.334 0 0 2.14 KB
Benchmarks.Trace.RedisBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendReceive net6.0 2.01μs 2.44ns 9.45ns 0 0 0 1.21 KB
master SendReceive netcoreapp3.1 2.53μs 12.7ns 53.8ns 0 0 0 1.21 KB
master SendReceive net472 2.98μs 3.81ns 14.8ns 0.18 0 0 1.21 KB
#7006 SendReceive net6.0 1.94μs 10ns 48.1ns 0 0 0 1.21 KB
#7006 SendReceive netcoreapp3.1 2.6μs 8.9ns 34.5ns 0 0 0 1.21 KB
#7006 SendReceive net472 3.05μs 1.66ns 6.2ns 0.182 0 0 1.21 KB
Benchmarks.Trace.SerilogBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 4.19μs 3.48ns 13ns 0 0 0 1.64 KB
master EnrichedLog netcoreapp3.1 5.65μs 7.8ns 30.2ns 0 0 0 1.69 KB
master EnrichedLog net472 6.46μs 7.81ns 30.2ns 0.321 0 0 2.08 KB
#7006 EnrichedLog net6.0 4.23μs 11.7ns 45.4ns 0 0 0 1.64 KB
#7006 EnrichedLog netcoreapp3.1 5.72μs 10.2ns 39.5ns 0 0 0 1.69 KB
#7006 EnrichedLog net472 6.49μs 5.85ns 22.6ns 0.324 0 0 2.08 KB
Benchmarks.Trace.SpanBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartFinishSpan net6.0 750ns 3.85ns 23.8ns 0 0 0 584 B
master StartFinishSpan netcoreapp3.1 944ns 4.6ns 18.4ns 0 0 0 584 B
master StartFinishSpan net472 925ns 0.225ns 0.871ns 0.0926 0 0 586 B
master StartFinishScope net6.0 930ns 4.11ns 14.8ns 0 0 0 704 B
master StartFinishScope netcoreapp3.1 1.16μs 6.08ns 31.6ns 0 0 0 704 B
master StartFinishScope net472 1.15μs 0.668ns 2.59ns 0.104 0 0 666 B
#7006 StartFinishSpan net6.0 756ns 3.99ns 19.5ns 0 0 0 584 B
#7006 StartFinishSpan netcoreapp3.1 955ns 4.91ns 22.5ns 0 0 0 584 B
#7006 StartFinishSpan net472 920ns 0.128ns 0.495ns 0.0893 0 0 586 B
#7006 StartFinishScope net6.0 894ns 4.17ns 17.2ns 0 0 0 704 B
#7006 StartFinishScope netcoreapp3.1 1.2μs 5.65ns 22.6ns 0 0 0 704 B
#7006 StartFinishScope net472 1.15μs 0.956ns 3.7ns 0.103 0 0 666 B
Benchmarks.Trace.TraceAnnotationsBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunOnMethodBegin net6.0 1.09μs 5.52ns 24.7ns 0 0 0 704 B
master RunOnMethodBegin netcoreapp3.1 1.34μs 6.62ns 28.9ns 0 0 0 704 B
master RunOnMethodBegin net472 1.34μs 0.948ns 3.67ns 0.1 0 0 666 B
#7006 RunOnMethodBegin net6.0 1.02μs 3.37ns 12.6ns 0 0 0 704 B
#7006 RunOnMethodBegin netcoreapp3.1 1.41μs 5.7ns 22.1ns 0 0 0 704 B
#7006 RunOnMethodBegin net472 1.42μs 0.681ns 2.64ns 0.0991 0 0 666 B

pr-commenter[bot] avatar May 26 '25 15:05 pr-commenter[bot]