[Profiler] Add Custom trait WithTracer
Summary of changes
Add a new trait WithTracer:
- To identify tests that run with the Tracer
- Setup environment to initialize test with or without the tracer.
Reason for change
The goal is to allow (later) to filter test that should run with the tracer or not. Hence, we will be able to run all tests on Profiler PRs and only tests WithTracer on Tracer PR.
Implementation details
- Add
WithTracerAttributeclass that inherit fromITraitAttirubte - Add the discoverer
- Change the code
Test coverage
All tests should run (since it's a Profiler PR)
Other details
Datadog Report
Branch report: gleocadie/add-custom-trait-for-profiler-test-with-tracer
Commit report: bc216c1
Test service: dd-trace-dotnet
:white_check_mark: 0 Failed, 331006 Passed, 1778 Skipped, 41m 28.63s Wall Time
Execution-Time Benchmarks Report :stopwatch:
Execution-time results for samples comparing the following branches/commits:
Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:
- Welch test with statistical test for significance of 5%
- Only results indicating a difference greater than 5% and 5 ms are considered.
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.
Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).
gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.6.2)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5501) - mean (73ms) : 63, 83
. : milestone, 73,
master - mean (74ms) : 65, 82
. : milestone, 74,
section CallTarget+Inlining+NGEN
This PR (5501) - mean (988ms) : 967, 1008
. : milestone, 988,
master - mean (987ms) : 965, 1009
. : milestone, 987,
gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5501) - mean (109ms) : 106, 113
. : milestone, 109,
master - mean (109ms) : 106, 112
. : milestone, 109,
section CallTarget+Inlining+NGEN
This PR (5501) - mean (690ms) : 669, 711
. : milestone, 690,
master - mean (693ms) : 672, 715
. : milestone, 693,
gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5501) - mean (93ms) : 90, 97
. : milestone, 93,
master - mean (93ms) : 90, 96
. : milestone, 93,
section CallTarget+Inlining+NGEN
This PR (5501) - mean (649ms) : 620, 677
. : milestone, 649,
master - mean (651ms) : 628, 675
. : milestone, 651,
gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.6.2)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5501) - mean (191ms) : 187, 195
. : milestone, 191,
master - mean (191ms) : 187, 196
. : milestone, 191,
section CallTarget+Inlining+NGEN
This PR (5501) - mean (1,079ms) : 1057, 1100
. : milestone, 1079,
master - mean (1,082ms) : 1060, 1104
. : milestone, 1082,
gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5501) - mean (277ms) : 272, 281
. : milestone, 277,
master - mean (276ms) : 272, 280
. : milestone, 276,
section CallTarget+Inlining+NGEN
This PR (5501) - mean (864ms) : 843, 885
. : milestone, 864,
master - mean (865ms) : 840, 890
. : milestone, 865,
gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5501) - mean (265ms) : 261, 270
. : milestone, 265,
master - mean (265ms) : 261, 269
. : milestone, 265,
section CallTarget+Inlining+NGEN
This PR (5501) - mean (854ms) : 829, 878
. : milestone, 854,
master - mean (850ms) : 830, 871
. : milestone, 850,
Benchmarks Report for tracer :snail:
Benchmarks for #5501 compared to master:
- 2 benchmarks are faster, with geometric mean 1.181
- All benchmarks have the same allocations
The following thresholds were used for comparing the benchmark speeds:
- Mann–Whitney U test with statistical test for significance of 5%
- Only results indicating a difference greater than 10% and 0.3 ns are considered.
Allocation changes below 0.5% are ignored.
Benchmark details
Benchmarks.Trace.ActivityBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | StartStopWithChild |
net6.0 | 7.88μs | 43.6ns | 282ns | 0.0186 | 0.00746 | 0 | 5.43 KB |
| master | StartStopWithChild |
netcoreapp3.1 | 9.86μs | 41.3ns | 160ns | 0.0238 | 0.00954 | 0 | 5.62 KB |
| master | StartStopWithChild |
net472 | 16.1μs | 77.5ns | 300ns | 1.03 | 0.324 | 0.0892 | 6.07 KB |
| #5501 | StartStopWithChild |
net6.0 | 7.75μs | 44.5ns | 336ns | 0.0199 | 0.00796 | 0 | 5.43 KB |
| #5501 | StartStopWithChild |
netcoreapp3.1 | 9.78μs | 53.9ns | 332ns | 0.0195 | 0.00977 | 0 | 5.61 KB |
| #5501 | StartStopWithChild |
net472 | 16.2μs | 68.9ns | 267ns | 1.02 | 0.304 | 0.096 | 6.08 KB |
Benchmarks.Trace.AgentWriterBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | WriteAndFlushEnrichedTraces |
net6.0 | 486μs | 171ns | 640ns | 0 | 0 | 0 | 2.7 KB |
| master | WriteAndFlushEnrichedTraces |
netcoreapp3.1 | 624μs | 255ns | 988ns | 0 | 0 | 0 | 2.7 KB |
| master | WriteAndFlushEnrichedTraces |
net472 | 836μs | 295ns | 1.1μs | 0.414 | 0 | 0 | 3.3 KB |
| #5501 | WriteAndFlushEnrichedTraces |
net6.0 | 457μs | 346ns | 1.34μs | 0 | 0 | 0 | 2.7 KB |
| #5501 | WriteAndFlushEnrichedTraces |
netcoreapp3.1 | 634μs | 163ns | 632ns | 0 | 0 | 0 | 2.7 KB |
| #5501 | WriteAndFlushEnrichedTraces |
net472 | 847μs | 171ns | 617ns | 0.422 | 0 | 0 | 3.3 KB |
Benchmarks.Trace.AspNetCoreBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | SendRequest |
net6.0 | 170μs | 191ns | 740ns | 0.253 | 0 | 0 | 18.44 KB |
| master | SendRequest |
netcoreapp3.1 | 190μs | 302ns | 1.17μs | 0.191 | 0 | 0 | 20.6 KB |
| master | SendRequest |
net472 | 0.000107ns | 5.57E‑05ns | 0.000208ns | 0 | 0 | 0 | 0 b |
| #5501 | SendRequest |
net6.0 | 168μs | 187ns | 725ns | 0.251 | 0 | 0 | 18.44 KB |
| #5501 | SendRequest |
netcoreapp3.1 | 191μs | 311ns | 1.16μs | 0.191 | 0 | 0 | 20.6 KB |
| #5501 | SendRequest |
net472 | 0ns | 0ns | 0ns | 0 | 0 | 0 | 0 b |
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | WriteAndFlushEnrichedTraces |
net6.0 | 533μs | 368ns | 1.43μs | 0.536 | 0 | 0 | 41.56 KB |
| master | WriteAndFlushEnrichedTraces |
netcoreapp3.1 | 646μs | 1.45μs | 5.63μs | 0.321 | 0 | 0 | 41.8 KB |
| master | WriteAndFlushEnrichedTraces |
net472 | 838μs | 4.2μs | 19.3μs | 8.28 | 2.48 | 0.414 | 53.2 KB |
| #5501 | WriteAndFlushEnrichedTraces |
net6.0 | 544μs | 357ns | 1.34μs | 0.532 | 0 | 0 | 41.69 KB |
| #5501 | WriteAndFlushEnrichedTraces |
netcoreapp3.1 | 652μs | 1.47μs | 5.71μs | 0.322 | 0 | 0 | 41.61 KB |
| #5501 | WriteAndFlushEnrichedTraces |
net472 | 857μs | 3.09μs | 12μs | 8.19 | 2.59 | 0.431 | 53.22 KB |
Benchmarks.Trace.DbCommandBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | ExecuteNonQuery |
net6.0 | 1.11μs | 0.742ns | 2.88ns | 0.0111 | 0 | 0 | 808 B |
| master | ExecuteNonQuery |
netcoreapp3.1 | 1.43μs | 0.91ns | 3.41ns | 0.0107 | 0 | 0 | 808 B |
| master | ExecuteNonQuery |
net472 | 1.67μs | 0.552ns | 2.07ns | 0.122 | 0 | 0 | 770 B |
| #5501 | ExecuteNonQuery |
net6.0 | 1.13μs | 2.04ns | 7.89ns | 0.0114 | 0 | 0 | 808 B |
| #5501 | ExecuteNonQuery |
netcoreapp3.1 | 1.47μs | 0.951ns | 3.68ns | 0.0103 | 0 | 0 | 808 B |
| #5501 | ExecuteNonQuery |
net472 | 1.78μs | 2.38ns | 9.21ns | 0.122 | 0 | 0 | 770 B |
Benchmarks.Trace.ElasticsearchBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | CallElasticsearch |
net6.0 | 1.11μs | 0.682ns | 2.64ns | 0.0139 | 0 | 0 | 976 B |
| master | CallElasticsearch |
netcoreapp3.1 | 1.59μs | 0.404ns | 1.51ns | 0.0135 | 0 | 0 | 976 B |
| master | CallElasticsearch |
net472 | 2.46μs | 1.67ns | 6.45ns | 0.157 | 0.00123 | 0 | 995 B |
| master | CallElasticsearchAsync |
net6.0 | 1.35μs | 0.628ns | 2.43ns | 0.0129 | 0 | 0 | 952 B |
| master | CallElasticsearchAsync |
netcoreapp3.1 | 1.63μs | 4.11ns | 15.4ns | 0.0138 | 0 | 0 | 1.02 KB |
| master | CallElasticsearchAsync |
net472 | 2.51μs | 1.06ns | 3.8ns | 0.166 | 0.00125 | 0 | 1.05 KB |
| #5501 | CallElasticsearch |
net6.0 | 1.17μs | 0.558ns | 2.09ns | 0.0135 | 0 | 0 | 976 B |
| #5501 | CallElasticsearch |
netcoreapp3.1 | 1.55μs | 2.31ns | 8.65ns | 0.0127 | 0 | 0 | 976 B |
| #5501 | CallElasticsearch |
net472 | 2.51μs | 1.07ns | 4ns | 0.158 | 0.00125 | 0 | 995 B |
| #5501 | CallElasticsearchAsync |
net6.0 | 1.27μs | 0.756ns | 2.83ns | 0.0133 | 0 | 0 | 952 B |
| #5501 | CallElasticsearchAsync |
netcoreapp3.1 | 1.62μs | 1.12ns | 4.17ns | 0.0138 | 0 | 0 | 1.02 KB |
| #5501 | CallElasticsearchAsync |
net472 | 2.5μs | 1.61ns | 6.22ns | 0.167 | 0.00125 | 0 | 1.05 KB |
Benchmarks.Trace.GraphQLBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | ExecuteAsync |
net6.0 | 1.2μs | 1.09ns | 4.22ns | 0.0132 | 0 | 0 | 952 B |
| master | ExecuteAsync |
netcoreapp3.1 | 1.71μs | 0.98ns | 3.53ns | 0.0128 | 0 | 0 | 952 B |
| master | ExecuteAsync |
net472 | 1.84μs | 0.807ns | 3.13ns | 0.145 | 0 | 0 | 915 B |
| #5501 | ExecuteAsync |
net6.0 | 1.16μs | 0.439ns | 1.64ns | 0.0133 | 0 | 0 | 952 B |
| #5501 | ExecuteAsync |
netcoreapp3.1 | 1.62μs | 0.62ns | 2.24ns | 0.0129 | 0 | 0 | 952 B |
| #5501 | ExecuteAsync |
net472 | 1.82μs | 1.04ns | 3.76ns | 0.145 | 0.000921 | 0 | 915 B |
Benchmarks.Trace.HttpClientBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | SendAsync |
net6.0 | 4.23μs | 2.42ns | 9.04ns | 0.0298 | 0 | 0 | 2.22 KB |
| master | SendAsync |
netcoreapp3.1 | 5.09μs | 9.41ns | 36.5ns | 0.0376 | 0 | 0 | 2.76 KB |
| master | SendAsync |
net472 | 7.67μs | 2.16ns | 7.47ns | 0.499 | 0 | 0 | 3.15 KB |
| #5501 | SendAsync |
net6.0 | 4.16μs | 1.64ns | 6.34ns | 0.0312 | 0 | 0 | 2.22 KB |
| #5501 | SendAsync |
netcoreapp3.1 | 5.56μs | 26.3ns | 102ns | 0.0356 | 0 | 0 | 2.76 KB |
| #5501 | SendAsync |
net472 | 7.69μs | 2.68ns | 10.4ns | 0.496 | 0 | 0 | 3.15 KB |
Benchmarks.Trace.ILoggerBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 1.46μs | 0.559ns | 2.16ns | 0.0234 | 0 | 0 | 1.64 KB |
| master | EnrichedLog |
netcoreapp3.1 | 2.24μs | 1.71ns | 6.63ns | 0.0225 | 0 | 0 | 1.64 KB |
| master | EnrichedLog |
net472 | 2.56μs | 0.89ns | 3.33ns | 0.249 | 0 | 0 | 1.57 KB |
| #5501 | EnrichedLog |
net6.0 | 1.56μs | 0.812ns | 3.15ns | 0.0226 | 0 | 0 | 1.64 KB |
| #5501 | EnrichedLog |
netcoreapp3.1 | 2.15μs | 0.855ns | 3.2ns | 0.0218 | 0 | 0 | 1.64 KB |
| #5501 | EnrichedLog |
net472 | 2.54μs | 3.11ns | 12ns | 0.249 | 0 | 0 | 1.57 KB |
Benchmarks.Trace.Log4netBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 116μs | 168ns | 649ns | 0.0563 | 0 | 0 | 4.28 KB |
| master | EnrichedLog |
netcoreapp3.1 | 119μs | 202ns | 784ns | 0 | 0 | 0 | 4.28 KB |
| master | EnrichedLog |
net472 | 149μs | 87.1ns | 302ns | 0.668 | 0.223 | 0 | 4.46 KB |
| #5501 | EnrichedLog |
net6.0 | 114μs | 144ns | 557ns | 0.0562 | 0 | 0 | 4.28 KB |
| #5501 | EnrichedLog |
netcoreapp3.1 | 119μs | 237ns | 919ns | 0.0594 | 0 | 0 | 4.28 KB |
| #5501 | EnrichedLog |
net472 | 146μs | 95.4ns | 370ns | 0.657 | 0.219 | 0 | 4.46 KB |
Benchmarks.Trace.NLogBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 2.93μs | 0.685ns | 2.56ns | 0.0307 | 0 | 0 | 2.2 KB |
| master | EnrichedLog |
netcoreapp3.1 | 4.17μs | 2.27ns | 8.79ns | 0.0291 | 0 | 0 | 2.2 KB |
| master | EnrichedLog |
net472 | 4.85μs | 2.93ns | 11ns | 0.32 | 0 | 0 | 2.02 KB |
| #5501 | EnrichedLog |
net6.0 | 2.95μs | 0.66ns | 2.55ns | 0.0308 | 0 | 0 | 2.2 KB |
| #5501 | EnrichedLog |
netcoreapp3.1 | 4.08μs | 1.77ns | 6.63ns | 0.0287 | 0 | 0 | 2.2 KB |
| #5501 | EnrichedLog |
net472 | 5.04μs | 10.1ns | 39.1ns | 0.32 | 0 | 0 | 2.02 KB |
Benchmarks.Trace.RedisBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | SendReceive |
net6.0 | 1.35μs | 0.772ns | 2.99ns | 0.0161 | 0 | 0 | 1.14 KB |
| master | SendReceive |
netcoreapp3.1 | 1.79μs | 3.68ns | 13.8ns | 0.0151 | 0 | 0 | 1.14 KB |
| master | SendReceive |
net472 | 2.04μs | 0.791ns | 2.96ns | 0.183 | 0.00103 | 0 | 1.16 KB |
| #5501 | SendReceive |
net6.0 | 1.38μs | 1.05ns | 4.07ns | 0.0159 | 0 | 0 | 1.14 KB |
| #5501 | SendReceive |
netcoreapp3.1 | 1.76μs | 1.52ns | 5.88ns | 0.0149 | 0 | 0 | 1.14 KB |
| #5501 | SendReceive |
net472 | 2.05μs | 0.781ns | 2.92ns | 0.184 | 0 | 0 | 1.16 KB |
Benchmarks.Trace.SerilogBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 2.66μs | 1.15ns | 4.46ns | 0.0226 | 0 | 0 | 1.6 KB |
| master | EnrichedLog |
netcoreapp3.1 | 3.96μs | 17.8ns | 64.1ns | 0.0216 | 0 | 0 | 1.65 KB |
| master | EnrichedLog |
net472 | 4.42μs | 2.76ns | 10.7ns | 0.324 | 0 | 0 | 2.04 KB |
| #5501 | EnrichedLog |
net6.0 | 2.74μs | 0.881ns | 3.3ns | 0.0229 | 0 | 0 | 1.6 KB |
| #5501 | EnrichedLog |
netcoreapp3.1 | 3.95μs | 1.51ns | 5.86ns | 0.0216 | 0 | 0 | 1.65 KB |
| #5501 | EnrichedLog |
net472 | 4.52μs | 2.54ns | 9.49ns | 0.323 | 0 | 0 | 2.04 KB |
Benchmarks.Trace.SpanBenchmark - Faster :tada: Same allocations :heavy_check_mark:
Faster :tada: in #5501
Benchmark
base/diff
Base Median (ns)
Diff Median (ns)
Modality
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑net472
1.178
688.17
584.04
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | StartFinishSpan |
net6.0 | 390ns | 0.222ns | 0.859ns | 0.00804 | 0 | 0 | 576 B |
| master | StartFinishSpan |
netcoreapp3.1 | 559ns | 0.27ns | 1.01ns | 0.00783 | 0 | 0 | 576 B |
| master | StartFinishSpan |
net472 | 688ns | 0.521ns | 2.02ns | 0.0916 | 0 | 0 | 578 B |
| master | StartFinishScope |
net6.0 | 507ns | 0.176ns | 0.682ns | 0.0096 | 0 | 0 | 696 B |
| master | StartFinishScope |
netcoreapp3.1 | 723ns | 0.39ns | 1.51ns | 0.00958 | 0 | 0 | 696 B |
| master | StartFinishScope |
net472 | 819ns | 0.543ns | 2.1ns | 0.105 | 0 | 0 | 658 B |
| #5501 | StartFinishSpan |
net6.0 | 393ns | 0.11ns | 0.412ns | 0.0081 | 0 | 0 | 576 B |
| #5501 | StartFinishSpan |
netcoreapp3.1 | 550ns | 0.228ns | 0.881ns | 0.008 | 0 | 0 | 576 B |
| #5501 | StartFinishSpan |
net472 | 584ns | 0.367ns | 1.42ns | 0.0915 | 0 | 0 | 578 B |
| #5501 | StartFinishScope |
net6.0 | 479ns | 0.186ns | 0.695ns | 0.00963 | 0 | 0 | 696 B |
| #5501 | StartFinishScope |
netcoreapp3.1 | 756ns | 0.214ns | 0.772ns | 0.00941 | 0 | 0 | 696 B |
| #5501 | StartFinishScope |
net472 | 780ns | 0.46ns | 1.78ns | 0.104 | 0 | 0 | 658 B |
Benchmarks.Trace.TraceAnnotationsBenchmark - Faster :tada: Same allocations :heavy_check_mark:
Faster :tada: in #5501
Benchmark
base/diff
Base Median (ns)
Diff Median (ns)
Modality
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net6.0
1.183
709.25
599.56
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | RunOnMethodBegin |
net6.0 | 709ns | 0.358ns | 1.39ns | 0.00964 | 0 | 0 | 696 B |
| master | RunOnMethodBegin |
netcoreapp3.1 | 979ns | 0.46ns | 1.72ns | 0.00919 | 0 | 0 | 696 B |
| master | RunOnMethodBegin |
net472 | 1.07μs | 0.388ns | 1.5ns | 0.104 | 0 | 0 | 658 B |
| #5501 | RunOnMethodBegin |
net6.0 | 599ns | 0.338ns | 1.31ns | 0.00993 | 0 | 0 | 696 B |
| #5501 | RunOnMethodBegin |
netcoreapp3.1 | 963ns | 0.472ns | 1.83ns | 0.00966 | 0 | 0 | 696 B |
| #5501 | RunOnMethodBegin |
net472 | 1.1μs | 0.716ns | 2.77ns | 0.104 | 0 | 0 | 658 B |
Throughput/Crank Report:zap:
Throughput results for AspNetCoreSimpleController comparing the following branches/commits:
Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red.
Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards!
gantt
title Throughput Linux x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5501) (11.530M) : 0, 11529764
master (11.453M) : 0, 11453115
benchmarks/2.9.0 (11.656M) : 0, 11655894
section Automatic
This PR (5501) (7.803M) : 0, 7803453
master (7.879M) : 0, 7879441
benchmarks/2.9.0 (8.153M) : 0, 8153210
section Trace stats
master (8.077M) : 0, 8077234
section Manual
This PR (5501) (9.993M) : 0, 9993006
master (10.071M) : 0, 10070775
section Manual + Automatic
This PR (5501) (7.383M) : 0, 7382961
master (7.434M) : 0, 7433784
section Version Conflict
master (6.643M) : 0, 6643187
gantt
title Throughput Linux arm64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5501) (9.549M) : 0, 9549142
master (9.461M) : 0, 9460908
benchmarks/2.9.0 (9.505M) : 0, 9504870
section Automatic
This PR (5501) (6.381M) : 0, 6381195
master (6.601M) : 0, 6600981
section Trace stats
master (6.704M) : 0, 6704417
section Manual
This PR (5501) (8.013M) : 0, 8013347
master (8.269M) : 0, 8268853
section Manual + Automatic
This PR (5501) (6.100M) : 0, 6099611
master (6.229M) : 0, 6229321
section Version Conflict
master (5.678M) : 0, 5677936
gantt
title Throughput Windows x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5501) (10.392M) : 0, 10391582
master (10.064M) : 0, 10063650
benchmarks/2.9.0 (10.370M) : 0, 10369822
section Automatic
This PR (5501) (7.135M) : 0, 7135386
master (7.048M) : 0, 7048367
benchmarks/2.9.0 (7.364M) : 0, 7364262
section Trace stats
master (7.400M) : 0, 7399566
section Manual
This PR (5501) (8.880M) : 0, 8880401
master (8.757M) : 0, 8757430
section Manual + Automatic
This PR (5501) (6.942M) : 0, 6942278
master (6.804M) : 0, 6804202
section Version Conflict
master (6.106M) : 0, 6106269
Datadog Report
Branch report: gleocadie/add-custom-trait-for-profiler-test-with-tracer
Commit report: c5f15ff
Test service: dd-trace-dotnet
:white_check_mark: 0 Failed, 322683 Passed, 970 Skipped, 7h 54m 28.76s Total Time :hourglass: 1 Performance Regression
:hourglass: Performance Regressions vs Default Branch (1)
SendAsync-Benchmarks.Trace.HttpClientBenchmark5.56µs (+457ns, +9%) - Details