dd-trace-dotnet icon indicating copy to clipboard operation
dd-trace-dotnet copied to clipboard
verified publisher icon DataDog

[Exception Replay] Groundwork to support Test Optimization

Open GreenMatan opened this issue 6 months ago • 3 comments

Summary of changes

Reason for change

Implementation details

Test coverage

Other details

GreenMatan avatar Jun 10 '25 14:06 GreenMatan

Datadog Report

All test runs 7faab92 :link:

:white_check_mark: 2 Total Test Services: 0 Failed, 2 Passed

Test Services
Service Name Failed Known Flaky New Flaky Passed Skipped Total Time Test Service View
dd-trace-dotnet 0 0 0 244932 6647 39h 55m 33.4s Link
exploration_tests 0 0 0 7433 0 10m 35.17s Link

datadog-datadog-prod-us1[bot] avatar Jun 10 '25 14:06 datadog-datadog-prod-us1[bot]

Execution-Time Benchmarks Report :stopwatch:

Execution-time results for samples comparing the following branches/commits:

Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:

  • Welch test with statistical test for significance of 5%
  • Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7085) - mean (76ms)  : 73, 78
     .   : milestone, 76,
    master - mean (75ms)  : 74, 77
     .   : milestone, 75,

    section Baseline
    This PR (7085) - mean (71ms)  : 68, 74
     .   : milestone, 71,
    master - mean (72ms)  : 68, 75
     .   : milestone, 72,

    section CallTarget+Inlining+NGEN
    This PR (7085) - mean (1,037ms)  : 1007, 1068
     .   : milestone, 1037,
    master - mean (1,034ms)  : 1013, 1056
     .   : milestone, 1034,


gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7085) - mean (111ms)  : 109, 113
     .   : milestone, 111,
    master - mean (109ms)  : 107, 111
     .   : milestone, 109,

    section Baseline
    This PR (7085) - mean (109ms)  : 107, 111
     .   : milestone, 109,
    master - mean (108ms)  : 105, 110
     .   : milestone, 108,

    section CallTarget+Inlining+NGEN
    This PR (7085) - mean (721ms)  : 705, 738
     .   : milestone, 721,
    master - mean (719ms)  : 694, 744
     .   : milestone, 719,


gantt
    title Execution time (ms) FakeDbCommand (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7085) - mean (97ms)  : 95, 99
     .   : milestone, 97,
    master - mean (97ms)  : 95, 98
     .   : milestone, 97,

    section Baseline
    This PR (7085) - mean (96ms)  : 94, 99
     .   : milestone, 96,
    master - mean (96ms)  : 94, 98
     .   : milestone, 96,

    section CallTarget+Inlining+NGEN
    This PR (7085) - mean (681ms)  : 657, 704
     .   : milestone, 681,
    master - mean (684ms)  : 657, 710
     .   : milestone, 684,


gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7085) - mean (198ms)  : 195, 201
     .   : milestone, 198,
    master - mean (199ms)  : 194, 204
     .   : milestone, 199,

    section Baseline
    This PR (7085) - mean (195ms)  : 189, 202
     .   : milestone, 195,
    master - mean (195ms)  : 189, 202
     .   : milestone, 195,

    section CallTarget+Inlining+NGEN
    This PR (7085) - mean (1,142ms)  : 1117, 1167
     .   : milestone, 1142,
    master - mean (1,148ms)  : 1124, 1172
     .   : milestone, 1148,


gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7085) - mean (278ms)  : 273, 283
     .   : milestone, 278,
    master - mean (276ms)  : 272, 281
     .   : milestone, 276,

    section Baseline
    This PR (7085) - mean (277ms)  : 271, 283
     .   : milestone, 277,
    master - mean (276ms)  : 271, 281
     .   : milestone, 276,

    section CallTarget+Inlining+NGEN
    This PR (7085) - mean (913ms)  : 887, 939
     .   : milestone, 913,
    master - mean (913ms)  : 880, 947
     .   : milestone, 913,


gantt
    title Execution time (ms) HttpMessageHandler (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7085) - mean (272ms)  : 267, 277
     .   : milestone, 272,
    master - mean (273ms)  : 267, 278
     .   : milestone, 273,

    section Baseline
    This PR (7085) - mean (272ms)  : 267, 277
     .   : milestone, 272,
    master - mean (272ms)  : 267, 277
     .   : milestone, 272,

    section CallTarget+Inlining+NGEN
    This PR (7085) - mean (907ms)  : 880, 934
     .   : milestone, 907,
    master - mean (906ms)  : 852, 960
     .   : milestone, 906,


gantt
    title Execution time (ms) HttpMessageHandler (.NET 8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7085) - mean (272ms)  : 267, 278
     .   : milestone, 272,
    master - mean (271ms)  : 267, 276
     .   : milestone, 271,

    section Baseline
    This PR (7085) - mean (271ms)  : 266, 276
     .   : milestone, 271,
    master - mean (271ms)  : 265, 278
     .   : milestone, 271,

    section CallTarget+Inlining+NGEN
    This PR (7085) - mean (812ms)  : 792, 833
     .   : milestone, 812,
    master - mean (809ms)  : 787, 831
     .   : milestone, 809,

andrewlock avatar Jun 10 '25 14:06 andrewlock

Benchmarks

Benchmarks Report for benchmark platform :snail:

Benchmarks for #7085 compared to master:

  • 1 benchmarks are slower, with geometric mean 1.209
  • 40 benchmarks have fewer allocations
  • 6 benchmarks have more allocations

The following thresholds were used for comparing the benchmark speeds:

  • Mann–Whitney U test with statistical test for significance of 5%
  • Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks.Trace.ActivityBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.ActivityBenchmark.StartStopWithChild‑netcoreapp3.1 5.75 KB 5.7 KB -56 B -0.97%
Benchmarks.Trace.ActivityBenchmark.StartStopWithChild‑net6.0 5.58 KB 5.51 KB -69 B -1.24%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartStopWithChild net6.0 11.2μs 59.7ns 322ns 0 0 0 5.58 KB
master StartStopWithChild netcoreapp3.1 14.1μs 67.5ns 286ns 0 0 0 5.75 KB
master StartStopWithChild net472 22.1μs 119ns 651ns 1.03 0.411 0.103 6.09 KB
#7085 StartStopWithChild net6.0 10.6μs 47.5ns 184ns 0 0 0 5.51 KB
#7085 StartStopWithChild netcoreapp3.1 13.7μs 64ns 248ns 0 0 0 5.7 KB
#7085 StartStopWithChild net472 22.3μs 125ns 826ns 0.957 0.319 0 6.12 KB
Benchmarks.Trace.AgentWriterBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 927μs 26.6ns 103ns 0 0 0 2.71 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 1.04ms 404ns 1.56μs 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces net472 1.25ms 357ns 1.38μs 0 0 0 3.33 KB
#7085 WriteAndFlushEnrichedTraces net6.0 938μs 57.5ns 215ns 0 0 0 2.71 KB
#7085 WriteAndFlushEnrichedTraces netcoreapp3.1 1.02ms 389ns 1.51μs 0 0 0 2.7 KB
#7085 WriteAndFlushEnrichedTraces net472 1.25ms 880ns 3.41μs 0 0 0 3.33 KB
Benchmarks.Trace.Asm.AppSecBodyBenchmark - Same speed :heavy_check_mark: More allocations :warning:

More allocations :warning: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody‑net472 236.35 KB 242.23 KB 5.88 KB 2.49%
Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody‑net472 239.87 KB 245.75 KB 5.88 KB 2.45%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master AllCycleSimpleBody net6.0 331μs 1.76μs 8.42μs 0 0 0 197.06 KB
master AllCycleSimpleBody netcoreapp3.1 510μs 1.45μs 5.61μs 0 0 0 204.77 KB
master AllCycleSimpleBody net472 436μs 119ns 460ns 36.6 2.16 0 236.35 KB
master AllCycleMoreComplexBody net6.0 338μs 1.76μs 8.8μs 0 0 0 200.56 KB
master AllCycleMoreComplexBody netcoreapp3.1 495μs 987ns 3.56μs 0 0 0 208.18 KB
master AllCycleMoreComplexBody net472 446μs 106ns 412ns 36.6 2.16 0 239.87 KB
master ObjectExtractorSimpleBody net6.0 311ns 1.77ns 12.3ns 0 0 0 280 B
master ObjectExtractorSimpleBody netcoreapp3.1 409ns 1.93ns 8.2ns 0 0 0 272 B
master ObjectExtractorSimpleBody net472 303ns 0.175ns 0.676ns 0.0442 0 0 281 B
master ObjectExtractorMoreComplexBody net6.0 6.52μs 29.5ns 110ns 0 0 0 3.78 KB
master ObjectExtractorMoreComplexBody netcoreapp3.1 7.76μs 36.2ns 140ns 0 0 0 3.69 KB
master ObjectExtractorMoreComplexBody net472 6.66μs 0.89ns 3.33ns 0.599 0 0 3.8 KB
#7085 AllCycleSimpleBody net6.0 336μs 489ns 1.9μs 0 0 0 197.61 KB
#7085 AllCycleSimpleBody netcoreapp3.1 510μs 814ns 3.15μs 0 0 0 205.37 KB
#7085 AllCycleSimpleBody net472 441μs 121ns 453ns 36.6 2.16 0 242.23 KB
#7085 AllCycleMoreComplexBody net6.0 341μs 1.66μs 6.63μs 0 0 0 201.12 KB
#7085 AllCycleMoreComplexBody netcoreapp3.1 494μs 1.85μs 7.18μs 0 0 0 208.78 KB
#7085 AllCycleMoreComplexBody net472 452μs 113ns 437ns 37.9 2.23 0 245.75 KB
#7085 ObjectExtractorSimpleBody net6.0 317ns 0.107ns 0.415ns 0 0 0 280 B
#7085 ObjectExtractorSimpleBody netcoreapp3.1 394ns 1.92ns 7.68ns 0 0 0 272 B
#7085 ObjectExtractorSimpleBody net472 306ns 0.0482ns 0.187ns 0.0431 0 0 281 B
#7085 ObjectExtractorMoreComplexBody net6.0 6.4μs 31.3ns 125ns 0 0 0 3.78 KB
#7085 ObjectExtractorMoreComplexBody netcoreapp3.1 7.69μs 31.5ns 122ns 0 0 0 3.69 KB
#7085 ObjectExtractorMoreComplexBody net472 6.8μs 4.14ns 16ns 0.578 0 0 3.8 KB
Benchmarks.Trace.Asm.AppSecEncoderBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs‑net6.0 2.16 KB 2.14 KB -12 B -0.56%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EncodeArgs net6.0 73.3μs 263ns 984ns 0 0 0 32.41 KB
master EncodeArgs netcoreapp3.1 95.7μs 36.2ns 130ns 0 0 0 32.4 KB
master EncodeArgs net472 107μs 17.6ns 65.8ns 4.82 0 0 32.51 KB
master EncodeLegacyArgs net6.0 143μs 122ns 472ns 0 0 0 2.16 KB
master EncodeLegacyArgs netcoreapp3.1 197μs 42.5ns 147ns 0 0 0 2.14 KB
master EncodeLegacyArgs net472 261μs 66.8ns 250ns 0 0 0 2.16 KB
#7085 EncodeArgs net6.0 77.3μs 87ns 326ns 0 0 0 32.4 KB
#7085 EncodeArgs netcoreapp3.1 101μs 539ns 2.8μs 0 0 0 32.46 KB
#7085 EncodeArgs net472 110μs 27ns 105ns 4.96 0 0 32.51 KB
#7085 EncodeLegacyArgs net6.0 147μs 28.8ns 108ns 0 0 0 2.14 KB
#7085 EncodeLegacyArgs netcoreapp3.1 194μs 142ns 512ns 0 0 0 2.14 KB
#7085 EncodeLegacyArgs net472 259μs 41.6ns 161ns 0 0 0 2.16 KB
Benchmarks.Trace.Asm.AppSecWafBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunWafRealisticBenchmark net6.0 271μs 133ns 499ns 0 0 0 4.55 KB
master RunWafRealisticBenchmark netcoreapp3.1 294μs 264ns 989ns 0 0 0 4.48 KB
master RunWafRealisticBenchmark net472 307μs 38.1ns 147ns 0 0 0 4.66 KB
master RunWafRealisticBenchmarkWithAttack net6.0 181μs 80.1ns 300ns 0 0 0 2.24 KB
master RunWafRealisticBenchmarkWithAttack netcoreapp3.1 198μs 104ns 404ns 0 0 0 2.22 KB
master RunWafRealisticBenchmarkWithAttack net472 207μs 45.3ns 169ns 0 0 0 2.28 KB
#7085 RunWafRealisticBenchmark net6.0 272μs 70.9ns 265ns 0 0 0 4.55 KB
#7085 RunWafRealisticBenchmark netcoreapp3.1 292μs 191ns 741ns 0 0 0 4.48 KB
#7085 RunWafRealisticBenchmark net472 309μs 45.1ns 174ns 0 0 0 4.66 KB
#7085 RunWafRealisticBenchmarkWithAttack net6.0 182μs 36.5ns 141ns 0 0 0 2.24 KB
#7085 RunWafRealisticBenchmarkWithAttack netcoreapp3.1 197μs 393ns 1.52μs 0 0 0 2.22 KB
#7085 RunWafRealisticBenchmarkWithAttack net472 207μs 24.3ns 94ns 0 0 0 2.28 KB
Benchmarks.Trace.AspNetCoreBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendRequest net6.0 61.1μs 29ns 104ns 0 0 0 14.53 KB
master SendRequest netcoreapp3.1 69.9μs 118ns 440ns 0 0 0 17.42 KB
master SendRequest net472 0.0171ns 0.00147ns 0.00551ns 0 0 0 0 b
#7085 SendRequest net6.0 61.2μs 37.3ns 139ns 0 0 0 14.52 KB
#7085 SendRequest netcoreapp3.1 71.1μs 50.1ns 187ns 0 0 0 17.42 KB
#7085 SendRequest net472 0.00509ns 0.00197ns 0.00763ns 0 0 0 0 b
Benchmarks.Trace.CharSliceBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
#7085 OriginalCharSlice net6.0 1.86ms 1.07μs 4.13μs 0 0 0 640 KB
#7085 OriginalCharSlice netcoreapp3.1 2.13ms 7.51μs 29.1μs 0 0 0 640 KB
#7085 OriginalCharSlice net472 2.59ms 131ns 492ns 100 0 0 641.95 KB
#7085 OptimizedCharSlice net6.0 1.38ms 449ns 1.74μs 0 0 0 4 B
#7085 OptimizedCharSlice netcoreapp3.1 1.71ms 239ns 926ns 0 0 0 1 B
#7085 OptimizedCharSlice net472 1.95ms 385ns 1.44μs 0 0 0 0 b
#7085 OptimizedCharSliceWithPool net6.0 858μs 34ns 132ns 0 0 0 4 B
#7085 OptimizedCharSliceWithPool netcoreapp3.1 828μs 40.9ns 153ns 0 0 0 0 b
#7085 OptimizedCharSliceWithPool net472 1.15ms 112ns 435ns 0 0 0 0 b
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed :heavy_check_mark: More allocations :warning:

More allocations :warning: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑net472 55.75 KB 56.42 KB 670 B 1.20%
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑net6.0 41.73 KB 41.97 KB 238 B 0.57%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 645μs 512ns 1.98μs 0 0 0 41.73 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 631μs 1.67μs 6.67μs 0 0 0 41.89 KB
master WriteAndFlushEnrichedTraces net472 923μs 1.93μs 7.2μs 4.46 0 0 55.75 KB
#7085 WriteAndFlushEnrichedTraces net6.0 696μs 2.31μs 8.93μs 0 0 0 41.97 KB
#7085 WriteAndFlushEnrichedTraces netcoreapp3.1 659μs 3.65μs 21.3μs 0 0 0 42.04 KB
#7085 WriteAndFlushEnrichedTraces net472 977μs 3.75μs 14.5μs 8.33 0 0 56.42 KB
Benchmarks.Trace.DbCommandBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.DbCommandBenchmark.ExecuteNonQuery‑net6.0 1.03 KB 1.02 KB -8 B -0.78%
Benchmarks.Trace.DbCommandBenchmark.ExecuteNonQuery‑netcoreapp3.1 1.02 KB 1.02 KB -8 B -0.78%
Benchmarks.Trace.DbCommandBenchmark.ExecuteNonQuery‑net472 995 B 987 B -8 B -0.80%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteNonQuery net6.0 1.99μs 10.2ns 46.8ns 0 0 0 1.03 KB
master ExecuteNonQuery netcoreapp3.1 2.53μs 3.43ns 13.3ns 0 0 0 1.02 KB
master ExecuteNonQuery net472 2.7μs 2.41ns 9.34ns 0.147 0.0134 0 995 B
#7085 ExecuteNonQuery net6.0 2.01μs 0.816ns 3.16ns 0 0 0 1.02 KB
#7085 ExecuteNonQuery netcoreapp3.1 2.58μs 1.35ns 5.21ns 0 0 0 1.02 KB
#7085 ExecuteNonQuery net472 2.8μs 2.37ns 9.19ns 0.154 0.014 0 987 B
Benchmarks.Trace.ElasticsearchBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync‑net472 1.11 KB 1.1 KB -8 B -0.72%
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync‑netcoreapp3.1 1.09 KB 1.08 KB -8 B -0.74%
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch‑net472 1.05 KB 1.04 KB -8 B -0.76%
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch‑net6.0 1.04 KB 1.03 KB -8 B -0.77%
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch‑netcoreapp3.1 1.04 KB 1.03 KB -8 B -0.77%
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync‑net6.0 1.02 KB 1.01 KB -8 B -0.79%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master CallElasticsearch net6.0 1.83μs 5.85ns 22.7ns 0 0 0 1.04 KB
master CallElasticsearch netcoreapp3.1 2.3μs 11.8ns 56.6ns 0 0 0 1.04 KB
master CallElasticsearch net472 3.55μs 3.05ns 11.8ns 0.159 0 0 1.05 KB
master CallElasticsearchAsync net6.0 1.81μs 3.89ns 14.5ns 0 0 0 1.02 KB
master CallElasticsearchAsync netcoreapp3.1 2.35μs 7.26ns 28.1ns 0 0 0 1.09 KB
master CallElasticsearchAsync net472 3.84μs 3.19ns 12.4ns 0.169 0 0 1.11 KB
#7085 CallElasticsearch net6.0 1.8μs 0.72ns 2.6ns 0 0 0 1.03 KB
#7085 CallElasticsearch netcoreapp3.1 2.26μs 9.29ns 34.8ns 0 0 0 1.03 KB
#7085 CallElasticsearch net472 3.78μs 5.14ns 19.9ns 0.151 0 0 1.04 KB
#7085 CallElasticsearchAsync net6.0 1.8μs 7.2ns 27.9ns 0 0 0 1.01 KB
#7085 CallElasticsearchAsync netcoreapp3.1 2.47μs 8.96ns 33.5ns 0 0 0 1.08 KB
#7085 CallElasticsearchAsync net472 3.85μs 3.85ns 14.9ns 0.174 0 0 1.1 KB
Benchmarks.Trace.GraphQLBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync‑net6.0 960 B 952 B -8 B -0.83%
Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync‑netcoreapp3.1 960 B 952 B -8 B -0.83%
Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync‑net472 923 B 915 B -8 B -0.87%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteAsync net6.0 1.78μs 9.27ns 43.5ns 0 0 0 960 B
master ExecuteAsync netcoreapp3.1 2.29μs 7.45ns 25.8ns 0 0 0 960 B
master ExecuteAsync net472 2.58μs 1.78ns 6.88ns 0.143 0 0 923 B
#7085 ExecuteAsync net6.0 1.84μs 3.49ns 13.5ns 0 0 0 952 B
#7085 ExecuteAsync netcoreapp3.1 2.34μs 2.29ns 8.86ns 0 0 0 952 B
#7085 ExecuteAsync net472 2.52μs 3.09ns 11.6ns 0.141 0 0 915 B
Benchmarks.Trace.HttpClientBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendAsync net6.0 7.1μs 10.4ns 39ns 0 0 0 2.37 KB
master SendAsync netcoreapp3.1 8.69μs 14.1ns 54.6ns 0 0 0 2.9 KB
master SendAsync net472 12.5μs 10.3ns 38.5ns 0.498 0 0 3.19 KB
#7085 SendAsync net6.0 6.87μs 1.78ns 6.43ns 0 0 0 2.36 KB
#7085 SendAsync netcoreapp3.1 8.5μs 5.47ns 20.5ns 0 0 0 2.9 KB
#7085 SendAsync net472 12.5μs 11.5ns 41.3ns 0.501 0 0 3.18 KB
Benchmarks.Trace.Iast.StringAspectsBenchmark - Slower :warning: More allocations :warning:

Slower :warning: in #7085

Benchmark diff/base Base Median (ns) Diff Median (ns) Modality
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1 1.209 413,700.00 500,200.00

More allocations :warning: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net6.0 259.96 KB 277.08 KB 17.12 KB 6.59%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑netcoreapp3.1 42.64 KB 43.22 KB 576 B 1.35%

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1 274.93 KB 261.27 KB -13.66 KB -4.97%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StringConcatBenchmark net6.0 44.6μs 212ns 1.6μs 0 0 0 43.83 KB
master StringConcatBenchmark netcoreapp3.1 47.2μs 224ns 838ns 0 0 0 42.64 KB
master StringConcatBenchmark net472 56.8μs 259ns 968ns 0 0 0 57.34 KB
master StringConcatAspectBenchmark net6.0 458μs 1.08μs 3.89μs 0 0 0 259.96 KB
master StringConcatAspectBenchmark netcoreapp3.1 447μs 6.44μs 63.7μs 0 0 0 274.93 KB
master StringConcatAspectBenchmark net472 410μs 2.07μs 9.27μs 0 0 0 286.72 KB
#7085 StringConcatBenchmark net6.0 48.7μs 263ns 1.47μs 0 0 0 43.85 KB
#7085 StringConcatBenchmark netcoreapp3.1 49.5μs 277ns 1.71μs 0 0 0 43.22 KB
#7085 StringConcatBenchmark net472 57.2μs 196ns 708ns 0 0 0 57.34 KB
#7085 StringConcatAspectBenchmark net6.0 507μs 1.34μs 4.63μs 0 0 0 277.08 KB
#7085 StringConcatAspectBenchmark netcoreapp3.1 504μs 2.46μs 10.1μs 0 0 0 261.27 KB
#7085 StringConcatAspectBenchmark net472 410μs 2.16μs 10.8μs 0 0 0 286.72 KB
Benchmarks.Trace.ILoggerBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.ILoggerBenchmark.EnrichedLog‑net6.0 1.76 KB 1.7 KB -56 B -3.18%
Benchmarks.Trace.ILoggerBenchmark.EnrichedLog‑netcoreapp3.1 1.76 KB 1.7 KB -56 B -3.18%
Benchmarks.Trace.ILoggerBenchmark.EnrichedLog‑net472 1.69 KB 1.64 KB -56 B -3.31%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 2.63μs 2.6ns 10.1ns 0 0 0 1.76 KB
master EnrichedLog netcoreapp3.1 3.44μs 4.38ns 17ns 0 0 0 1.76 KB
master EnrichedLog net472 4.05μs 4.83ns 18.7ns 0.265 0 0 1.69 KB
#7085 EnrichedLog net6.0 2.62μs 12.3ns 47.8ns 0 0 0 1.7 KB
#7085 EnrichedLog netcoreapp3.1 3.57μs 16.8ns 65ns 0 0 0 1.7 KB
#7085 EnrichedLog net472 3.91μs 2.63ns 9.85ns 0.254 0 0 1.64 KB
Benchmarks.Trace.Log4netBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Log4netBenchmark.EnrichedLog‑net472 4.57 KB 4.52 KB -55 B -1.20%
Benchmarks.Trace.Log4netBenchmark.EnrichedLog‑netcoreapp3.1 4.37 KB 4.31 KB -56 B -1.28%
Benchmarks.Trace.Log4netBenchmark.EnrichedLog‑net6.0 4.37 KB 4.31 KB -58 B -1.33%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 123μs 145ns 563ns 0 0 0 4.37 KB
master EnrichedLog netcoreapp3.1 126μs 330ns 1.24μs 0 0 0 4.37 KB
master EnrichedLog net472 167μs 161ns 603ns 0 0 0 4.57 KB
#7085 EnrichedLog net6.0 122μs 119ns 446ns 0 0 0 4.31 KB
#7085 EnrichedLog netcoreapp3.1 127μs 119ns 445ns 0 0 0 4.31 KB
#7085 EnrichedLog net472 167μs 76.8ns 277ns 0 0 0 4.52 KB
Benchmarks.Trace.NLogBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.NLogBenchmark.EnrichedLog‑net6.0 2.32 KB 2.26 KB -56 B -2.41%
Benchmarks.Trace.NLogBenchmark.EnrichedLog‑netcoreapp3.1 2.32 KB 2.26 KB -56 B -2.41%
Benchmarks.Trace.NLogBenchmark.EnrichedLog‑net472 2.14 KB 2.08 KB -56 B -2.62%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 4.94μs 19.3ns 74.6ns 0 0 0 2.32 KB
master EnrichedLog netcoreapp3.1 6.77μs 22.2ns 79.9ns 0 0 0 2.32 KB
master EnrichedLog net472 7.45μs 8.04ns 31.1ns 0.335 0 0 2.14 KB
#7085 EnrichedLog net6.0 5.03μs 3.57ns 13.4ns 0 0 0 2.26 KB
#7085 EnrichedLog netcoreapp3.1 7.02μs 19.8ns 76.6ns 0 0 0 2.26 KB
#7085 EnrichedLog net472 7.78μs 13.6ns 52.6ns 0.312 0 0 2.08 KB
Benchmarks.Trace.RedisBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.RedisBenchmark.SendReceive‑net472 1.21 KB 1.2 KB -8 B -0.66%
Benchmarks.Trace.RedisBenchmark.SendReceive‑net6.0 1.21 KB 1.2 KB -8 B -0.66%
Benchmarks.Trace.RedisBenchmark.SendReceive‑netcoreapp3.1 1.21 KB 1.2 KB -8 B -0.66%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendReceive net6.0 2.04μs 10.5ns 49.4ns 0 0 0 1.21 KB
master SendReceive netcoreapp3.1 2.53μs 11.8ns 47.4ns 0 0 0 1.21 KB
master SendReceive net472 3.28μs 2.71ns 10.5ns 0.178 0 0 1.21 KB
#7085 SendReceive net6.0 2.07μs 3.66ns 14.2ns 0 0 0 1.2 KB
#7085 SendReceive netcoreapp3.1 2.56μs 10.1ns 39ns 0 0 0 1.2 KB
#7085 SendReceive net472 3.21μs 3.82ns 14.8ns 0.178 0 0 1.2 KB
Benchmarks.Trace.SerilogBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.SerilogBenchmark.EnrichedLog‑net472 2.08 KB 2.03 KB -56 B -2.69%
Benchmarks.Trace.SerilogBenchmark.EnrichedLog‑netcoreapp3.1 1.69 KB 1.63 KB -56 B -3.32%
Benchmarks.Trace.SerilogBenchmark.EnrichedLog‑net6.0 1.64 KB 1.58 KB -56 B -3.41%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 4.18μs 0.92ns 3.44ns 0 0 0 1.64 KB
master EnrichedLog netcoreapp3.1 5.64μs 23ns 89.3ns 0 0 0 1.69 KB
master EnrichedLog net472 6.67μs 7.28ns 27.3ns 0.298 0 0 2.08 KB
#7085 EnrichedLog net6.0 4.19μs 4.01ns 15.5ns 0 0 0 1.58 KB
#7085 EnrichedLog netcoreapp3.1 5.48μs 13.4ns 48.3ns 0 0 0 1.63 KB
#7085 EnrichedLog net472 6.77μs 9.97ns 38.6ns 0.301 0 0 2.03 KB
Benchmarks.Trace.SpanBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.SpanBenchmark.StartFinishScope‑net6.0 704 B 696 B -8 B -1.14%
Benchmarks.Trace.SpanBenchmark.StartFinishScope‑netcoreapp3.1 704 B 696 B -8 B -1.14%
Benchmarks.Trace.SpanBenchmark.StartFinishScope‑net472 666 B 658 B -8 B -1.20%
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑net472 586 B 578 B -8 B -1.37%
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑net6.0 584 B 576 B -8 B -1.37%
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑netcoreapp3.1 584 B 576 B -8 B -1.37%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartFinishSpan net6.0 751ns 3.97ns 22.4ns 0 0 0 584 B
master StartFinishSpan netcoreapp3.1 953ns 4.42ns 17.7ns 0 0 0 584 B
master StartFinishSpan net472 914ns 0.809ns 3.13ns 0.0912 0 0 586 B
master StartFinishScope net6.0 918ns 0.479ns 1.73ns 0 0 0 704 B
master StartFinishScope netcoreapp3.1 1.15μs 6.24ns 34.2ns 0 0 0 704 B
master StartFinishScope net472 1.09μs 0.174ns 0.652ns 0.104 0 0 666 B
#7085 StartFinishSpan net6.0 762ns 3.63ns 15.4ns 0 0 0 576 B
#7085 StartFinishSpan netcoreapp3.1 951ns 4.48ns 17.9ns 0 0 0 576 B
#7085 StartFinishSpan net472 912ns 0.501ns 1.88ns 0.0874 0 0 578 B
#7085 StartFinishScope net6.0 903ns 0.457ns 1.71ns 0 0 0 696 B
#7085 StartFinishScope netcoreapp3.1 1.17μs 5.9ns 27ns 0 0 0 696 B
#7085 StartFinishScope net472 1.12μs 0.833ns 3.23ns 0.101 0 0 658 B
Benchmarks.Trace.TraceAnnotationsBenchmark - Same speed :heavy_check_mark: Fewer allocations :tada:

Fewer allocations :tada: in #7085

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net6.0 704 B 696 B -8 B -1.14%
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑netcoreapp3.1 704 B 696 B -8 B -1.14%
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net472 666 B 658 B -8 B -1.20%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunOnMethodBegin net6.0 1.02μs 5.36ns 26.8ns 0 0 0 704 B
master RunOnMethodBegin netcoreapp3.1 1.38μs 2.28ns 8.82ns 0 0 0 704 B
master RunOnMethodBegin net472 1.36μs 0.141ns 0.544ns 0.102 0 0 666 B
#7085 RunOnMethodBegin net6.0 1.05μs 0.493ns 1.91ns 0 0 0 696 B
#7085 RunOnMethodBegin netcoreapp3.1 1.41μs 3.85ns 14.4ns 0 0 0 696 B
#7085 RunOnMethodBegin net472 1.4μs 0.992ns 3.71ns 0.104 0 0 658 B

pr-commenter[bot] avatar Jun 12 '25 16:06 pr-commenter[bot]