dd-trace-dotnet icon indicating copy to clipboard operation
dd-trace-dotnet copied to clipboard
verified publisher icon DataDog

[Profiler] Add entry points for profiler telemetry related to SSI

Open chrisnas opened this issue 1 year ago • 7 comments

Summary of changes

Add IProfilerTelemetry definition and implementation to be able to send metrics related to SSI deployment and impacts on the generated or not profiles based on heuristics (first span created and process lifetime > 30 seconds)

Reason for change

Get statistics about heuristics effects when deployed with SSI

Implementation details

Test coverage

Other details

chrisnas avatar Feb 26 '24 18:02 chrisnas

Execution-Time Benchmarks Report :stopwatch:

Execution-time results for samples comparing the following branches/commits:

Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:

  • Welch test with statistical test for significance of 5%
  • Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

andrewlock avatar Feb 26 '24 18:02 andrewlock

Datadog Report

Branch report: chrisnas/support_ssi_telemetry Commit report: 08f4345 Test service: dd-trace-dotnet

:white_check_mark: 0 Failed, 336167 Passed, 1888 Skipped, 43m 34.01s Wall Time

datadog-ddstaging[bot] avatar Feb 26 '24 18:02 datadog-ddstaging[bot]

Benchmarks Report :snail:

Benchmarks for #5240 compared to master:

  • 3 benchmarks are faster, with geometric mean 1.262
  • 1 benchmarks are slower, with geometric mean 1.157
  • 1 benchmarks have fewer allocations
  • 3 benchmarks have more allocations

The following thresholds were used for comparing the benchmark speeds:

  • Mann–Whitney U test with statistical test for significance of 5%
  • Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks.Trace.ActivityBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartStopWithChild net6.0 8.83μs 46.6ns 223ns 0.0215 0.00859 0 7.5 KB
master StartStopWithChild netcoreapp3.1 10.5μs 56.7ns 300ns 0.0258 0.0103 0 7.58 KB
master StartStopWithChild net472 16.9μs 81.7ns 316ns 1.35 0.363 0.132 7.95 KB
#5240 StartStopWithChild net6.0 8.7μs 48.5ns 295ns 0.0306 0.0131 0 7.48 KB
#5240 StartStopWithChild netcoreapp3.1 10.8μs 58.9ns 358ns 0.0312 0.0156 0 7.59 KB
#5240 StartStopWithChild net472 17μs 65.2ns 252ns 1.33 0.363 0.101 7.96 KB
Benchmarks.Trace.AgentWriterBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 457μs 491ns 1.9μs 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 624μs 198ns 766ns 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces net472 818μs 390ns 1.51μs 0.411 0 0 3.3 KB
#5240 WriteAndFlushEnrichedTraces net6.0 488μs 173ns 623ns 0 0 0 2.7 KB
#5240 WriteAndFlushEnrichedTraces netcoreapp3.1 611μs 244ns 913ns 0 0 0 2.7 KB
#5240 WriteAndFlushEnrichedTraces net472 810μs 399ns 1.49μs 0.403 0 0 3.3 KB
Benchmarks.Trace.Asm.AppSecBodyBenchmark - Slower :warning: Same allocations :heavy_check_mark:

Slower :warning: in #5240

Benchmark diff/base Base Median (ns) Diff Median (ns) Modality
Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody‑net472 1.157 171.88 198.92

Faster :tada: in #5240

Benchmark base/diff Base Median (ns) Diff Median (ns) Modality
Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody‑netcoreapp3.1 1.216 245.33 201.80

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master AllCycleSimpleBody net6.0 40.4μs 16.9ns 61ns 0.0202 0 0 2.36 KB
master AllCycleSimpleBody netcoreapp3.1 43.7μs 22ns 79.3ns 0.0219 0 0 2.34 KB
master AllCycleSimpleBody net472 47μs 13.4ns 50.1ns 0.375 0 0 2.41 KB
master AllCycleMoreComplexBody net6.0 213μs 89.6ns 347ns 0.106 0 0 9.84 KB
master AllCycleMoreComplexBody netcoreapp3.1 224μs 183ns 686ns 0.112 0 0 9.73 KB
master AllCycleMoreComplexBody net472 240μs 90.4ns 350ns 1.56 0 0 9.91 KB
master ObjectExtractorSimpleBody net6.0 141ns 0.058ns 0.209ns 0.00395 0 0 280 B
master ObjectExtractorSimpleBody netcoreapp3.1 245ns 0.1ns 0.376ns 0.00369 0 0 272 B
master ObjectExtractorSimpleBody net472 172ns 0.111ns 0.428ns 0.0446 0 0 281 B
master ObjectExtractorMoreComplexBody net6.0 3.04μs 1.67ns 6.23ns 0.0532 0 0 3.78 KB
master ObjectExtractorMoreComplexBody netcoreapp3.1 4.03μs 1.75ns 6.55ns 0.0503 0 0 3.69 KB
master ObjectExtractorMoreComplexBody net472 4.44μs 2.23ns 8.62ns 0.603 0.00665 0 3.8 KB
#5240 AllCycleSimpleBody net6.0 41.7μs 76.2ns 295ns 0.021 0 0 2.36 KB
#5240 AllCycleSimpleBody netcoreapp3.1 44.6μs 80ns 310ns 0.0222 0 0 2.34 KB
#5240 AllCycleSimpleBody net472 47.3μs 62.7ns 243ns 0.373 0 0 2.41 KB
#5240 AllCycleMoreComplexBody net6.0 215μs 48.5ns 181ns 0.108 0 0 9.84 KB
#5240 AllCycleMoreComplexBody netcoreapp3.1 226μs 193ns 748ns 0.113 0 0 9.73 KB
#5240 AllCycleMoreComplexBody net472 240μs 83.1ns 311ns 1.56 0 0 9.91 KB
#5240 ObjectExtractorSimpleBody net6.0 139ns 0.132ns 0.51ns 0.00395 0 0 280 B
#5240 ObjectExtractorSimpleBody netcoreapp3.1 202ns 0.109ns 0.424ns 0.00365 0 0 272 B
#5240 ObjectExtractorSimpleBody net472 199ns 0.0898ns 0.336ns 0.0446 0 0 281 B
#5240 ObjectExtractorMoreComplexBody net6.0 2.96μs 1.11ns 4.15ns 0.0531 0 0 3.78 KB
#5240 ObjectExtractorMoreComplexBody netcoreapp3.1 3.98μs 2.08ns 7.51ns 0.0498 0 0 3.69 KB
#5240 ObjectExtractorMoreComplexBody net472 4.23μs 3ns 11.6ns 0.602 0.00634 0 3.8 KB
Benchmarks.Trace.Asm.AppSecEncoderBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EncodeArgs net6.0 53.5μs 74.6ns 289ns 0.429 0 0 30.94 KB
master EncodeArgs netcoreapp3.1 70.9μs 58.6ns 219ns 0.425 0 0 31.47 KB
master EncodeArgs net472 84.8μs 38.2ns 138ns 5.12 0.086 0 32.27 KB
master EncodeLegacyArgs net6.0 128μs 154ns 578ns 0.444 0 0 33.89 KB
master EncodeLegacyArgs netcoreapp3.1 155μs 157ns 608ns 0.453 0 0 34.09 KB
master EncodeLegacyArgs net472 214μs 557ns 2.16μs 5.47 0.429 0 34.99 KB
#5240 EncodeArgs net6.0 51.8μs 61ns 228ns 0.415 0 0 30.94 KB
#5240 EncodeArgs netcoreapp3.1 70.2μs 134ns 518ns 0.415 0 0 31.47 KB
#5240 EncodeArgs net472 84.7μs 98.3ns 381ns 5.1 0.0842 0 32.27 KB
#5240 EncodeLegacyArgs net6.0 127μs 595ns 2.31μs 0.424 0 0 33.89 KB
#5240 EncodeLegacyArgs netcoreapp3.1 156μs 425ns 1.65μs 0.466 0 0 34.09 KB
#5240 EncodeLegacyArgs net472 211μs 164ns 592ns 5.51 0.424 0 34.99 KB
Benchmarks.Trace.Asm.AppSecWafBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunWafRealisticBenchmark net6.0 190μs 526ns 2.04μs 0.0953 0 0 6.51 KB
master RunWafRealisticBenchmark netcoreapp3.1 207μs 446ns 1.73μs 0 0 0 6.49 KB
master RunWafRealisticBenchmark net472 224μs 113ns 438ns 1.01 0 0 6.59 KB
master RunWafRealisticBenchmarkWithAttack net6.0 125μs 81.6ns 294ns 0.0627 0 0 4.15 KB
master RunWafRealisticBenchmarkWithAttack netcoreapp3.1 135μs 216ns 835ns 0 0 0 4.15 KB
master RunWafRealisticBenchmarkWithAttack net472 147μs 163ns 630ns 0.66 0 0 4.19 KB
#5240 RunWafRealisticBenchmark net6.0 191μs 158ns 612ns 0.0962 0 0 6.51 KB
#5240 RunWafRealisticBenchmark netcoreapp3.1 206μs 302ns 1.17μs 0 0 0 6.49 KB
#5240 RunWafRealisticBenchmark net472 225μs 98.1ns 380ns 1.01 0 0 6.59 KB
#5240 RunWafRealisticBenchmarkWithAttack net6.0 127μs 157ns 566ns 0.0628 0 0 4.15 KB
#5240 RunWafRealisticBenchmarkWithAttack netcoreapp3.1 139μs 240ns 929ns 0 0 0 4.15 KB
#5240 RunWafRealisticBenchmarkWithAttack net472 148μs 64.5ns 250ns 0.663 0 0 4.19 KB
Benchmarks.Trace.AspNetCoreBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendRequest net6.0 175μs 205ns 794ns 0.174 0 0 18.26 KB
master SendRequest netcoreapp3.1 195μs 271ns 1.05μs 0.195 0 0 20.42 KB
master SendRequest net472 0.000804ns 0.000236ns 0.000883ns 0 0 0 0 b
#5240 SendRequest net6.0 172μs 150ns 563ns 0.171 0 0 18.26 KB
#5240 SendRequest netcoreapp3.1 194μs 197ns 763ns 0.193 0 0 20.42 KB
#5240 SendRequest net472 2.09E‑05ns 2.09E‑05ns 7.55E‑05ns 0 0 0 0 b
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 553μs 801ns 3.1μs 0.551 0 0 41.69 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 646μs 320ns 1.11μs 0.326 0 0 41.67 KB
master WriteAndFlushEnrichedTraces net472 838μs 2.08μs 8.07μs 8.45 2.53 0.422 53.24 KB
#5240 WriteAndFlushEnrichedTraces net6.0 537μs 577ns 2.24μs 0.539 0 0 41.76 KB
#5240 WriteAndFlushEnrichedTraces netcoreapp3.1 655μs 1.35μs 5.22μs 0.332 0 0 41.79 KB
#5240 WriteAndFlushEnrichedTraces net472 836μs 2.03μs 7.86μs 8.08 2.55 0.425 53.26 KB
Benchmarks.Trace.DbCommandBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteNonQuery net6.0 1.12μs 0.385ns 1.39ns 0.0112 0 0 776 B
master ExecuteNonQuery netcoreapp3.1 1.5μs 1.75ns 6.79ns 0.00992 0 0 776 B
master ExecuteNonQuery net472 1.75μs 0.917ns 3.18ns 0.117 0 0 738 B
#5240 ExecuteNonQuery net6.0 1.22μs 0.569ns 2.13ns 0.011 0 0 776 B
#5240 ExecuteNonQuery netcoreapp3.1 1.48μs 0.536ns 2.01ns 0.0103 0 0 776 B
#5240 ExecuteNonQuery net472 1.78μs 1.62ns 6.07ns 0.117 0 0 738 B
Benchmarks.Trace.ElasticsearchBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master CallElasticsearch net6.0 1.18μs 0.597ns 2.31ns 0.0131 0 0 944 B
master CallElasticsearch netcoreapp3.1 1.54μs 1.12ns 4.18ns 0.0124 0 0 944 B
master CallElasticsearch net472 2.51μs 0.926ns 3.59ns 0.153 0 0 963 B
master CallElasticsearchAsync net6.0 1.3μs 0.595ns 2.23ns 0.013 0 0 920 B
master CallElasticsearchAsync netcoreapp3.1 1.64μs 1.33ns 5.15ns 0.0133 0 0 992 B
master CallElasticsearchAsync net472 2.63μs 0.924ns 3.58ns 0.162 0 0 1.02 KB
#5240 CallElasticsearch net6.0 1.18μs 0.523ns 2.03ns 0.0129 0 0 944 B
#5240 CallElasticsearch netcoreapp3.1 1.5μs 0.518ns 1.94ns 0.0131 0 0 944 B
#5240 CallElasticsearch net472 2.48μs 0.446ns 1.61ns 0.153 0 0 963 B
#5240 CallElasticsearchAsync net6.0 1.26μs 0.483ns 1.74ns 0.0126 0 0 920 B
#5240 CallElasticsearchAsync netcoreapp3.1 1.67μs 0.506ns 1.89ns 0.0135 0 0 992 B
#5240 CallElasticsearchAsync net472 2.7μs 1.73ns 6.24ns 0.161 0 0 1.02 KB
Benchmarks.Trace.GraphQLBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteAsync net6.0 1.19μs 1.41ns 5.45ns 0.0132 0 0 920 B
master ExecuteAsync netcoreapp3.1 1.63μs 0.968ns 3.75ns 0.0123 0 0 920 B
master ExecuteAsync net472 1.82μs 0.915ns 3.54ns 0.14 0 0 883 B
#5240 ExecuteAsync net6.0 1.25μs 0.391ns 1.51ns 0.0125 0 0 920 B
#5240 ExecuteAsync netcoreapp3.1 1.61μs 1.09ns 4.08ns 0.012 0 0 920 B
#5240 ExecuteAsync net472 1.8μs 0.856ns 3.32ns 0.14 0 0 883 B
Benchmarks.Trace.HttpClientBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendAsync net6.0 4.03μs 1.83ns 6.85ns 0.0282 0 0 2.1 KB
master SendAsync netcoreapp3.1 5.04μs 2.56ns 9.57ns 0.0355 0 0 2.64 KB
master SendAsync net472 7.81μs 1.92ns 7.42ns 0.524 0 0 3.31 KB
#5240 SendAsync net6.0 4μs 2.37ns 8.87ns 0.0299 0 0 2.1 KB
#5240 SendAsync netcoreapp3.1 4.81μs 2.01ns 7.52ns 0.0363 0 0 2.64 KB
#5240 SendAsync net472 7.73μs 2.64ns 10.2ns 0.525 0 0 3.31 KB
Benchmarks.Trace.Iast.StringAspectsBenchmark - Same speed :heavy_check_mark: More allocations :warning:

More allocations :warning: in #5240

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1 202.26 KB 205.27 KB 3.02 KB 1.49%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑net472 60.95 KB 61.83 KB 880 B 1.44%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net6.0 203.6 KB 204.9 KB 1.3 KB 0.64%

Fewer allocations :tada: in #5240

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net472 229.38 KB 221.18 KB -8.19 KB -3.57%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StringConcatBenchmark net6.0 61.3μs 1.04μs 10.2μs 0 0 0 43.44 KB
master StringConcatBenchmark netcoreapp3.1 53.1μs 258ns 1.06μs 0 0 0 42.64 KB
master StringConcatBenchmark net472 37.9μs 93.5ns 350ns 0 0 0 60.95 KB
master StringConcatAspectBenchmark net6.0 279μs 1.02μs 3.52μs 0 0 0 203.6 KB
master StringConcatAspectBenchmark netcoreapp3.1 282μs 1.51μs 8.92μs 0 0 0 202.26 KB
master StringConcatAspectBenchmark net472 226μs 1.2μs 6.48μs 0 0 0 229.38 KB
#5240 StringConcatBenchmark net6.0 57.5μs 567ns 5.52μs 0 0 0 43.44 KB
#5240 StringConcatBenchmark netcoreapp3.1 56.8μs 546ns 5.32μs 0 0 0 42.64 KB
#5240 StringConcatBenchmark net472 36.8μs 44.9ns 156ns 0 0 0 61.83 KB
#5240 StringConcatAspectBenchmark net6.0 271μs 1.2μs 6.11μs 0 0 0 204.9 KB
#5240 StringConcatAspectBenchmark netcoreapp3.1 306μs 1.72μs 11.9μs 0 0 0 205.27 KB
#5240 StringConcatAspectBenchmark net472 239μs 2.49μs 23.5μs 0 0 0 221.18 KB
Benchmarks.Trace.ILoggerBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 1.42μs 0.666ns 2.49ns 0.022 0 0 1.58 KB
master EnrichedLog netcoreapp3.1 2.26μs 0.925ns 3.58ns 0.0217 0 0 1.58 KB
master EnrichedLog net472 2.59μs 3.23ns 12.5ns 0.239 0 0 1.51 KB
#5240 EnrichedLog net6.0 1.54μs 0.99ns 3.83ns 0.0218 0 0 1.58 KB
#5240 EnrichedLog netcoreapp3.1 2.24μs 0.842ns 3.15ns 0.0214 0 0 1.58 KB
#5240 EnrichedLog net472 2.46μs 1.42ns 5.31ns 0.239 0 0 1.51 KB
Benchmarks.Trace.Log4netBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 113μs 117ns 454ns 0.0566 0 0 4.22 KB
master EnrichedLog netcoreapp3.1 119μs 204ns 790ns 0 0 0 4.22 KB
master EnrichedLog net472 148μs 212ns 822ns 0.67 0.223 0 4.4 KB
#5240 EnrichedLog net6.0 113μs 69.1ns 268ns 0.0562 0 0 4.22 KB
#5240 EnrichedLog netcoreapp3.1 120μs 193ns 721ns 0 0 0 4.22 KB
#5240 EnrichedLog net472 148μs 100ns 388ns 0.665 0.222 0 4.4 KB
Benchmarks.Trace.NLogBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 3.01μs 1.82ns 6.82ns 0.0301 0 0 2.14 KB
master EnrichedLog netcoreapp3.1 4.15μs 1.39ns 5.2ns 0.0291 0 0 2.14 KB
master EnrichedLog net472 4.84μs 2.06ns 7.99ns 0.309 0 0 1.95 KB
#5240 EnrichedLog net6.0 3.08μs 0.99ns 3.84ns 0.0296 0 0 2.14 KB
#5240 EnrichedLog netcoreapp3.1 4.32μs 3.13ns 11.3ns 0.0285 0 0 2.14 KB
#5240 EnrichedLog net472 4.8μs 0.957ns 3.58ns 0.31 0 0 1.95 KB
Benchmarks.Trace.RedisBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendReceive net6.0 1.4μs 0.516ns 2ns 0.0155 0 0 1.11 KB
master SendReceive netcoreapp3.1 1.77μs 0.867ns 3.36ns 0.015 0 0 1.11 KB
master SendReceive net472 2.11μs 1.3ns 4.88ns 0.178 0 0 1.12 KB
#5240 SendReceive net6.0 1.33μs 0.631ns 2.45ns 0.0153 0 0 1.11 KB
#5240 SendReceive netcoreapp3.1 1.7μs 3.39ns 13.1ns 0.0152 0 0 1.11 KB
#5240 SendReceive net472 2.12μs 1.67ns 6.48ns 0.178 0 0 1.12 KB
Benchmarks.Trace.SerilogBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 2.78μs 1.1ns 4.27ns 0.0222 0 0 1.54 KB
master EnrichedLog netcoreapp3.1 3.86μs 2.82ns 10.9ns 0.0212 0 0 1.58 KB
master EnrichedLog net472 4.3μs 1.84ns 7.14ns 0.313 0 0 1.97 KB
#5240 EnrichedLog net6.0 2.71μs 0.869ns 3.25ns 0.0217 0 0 1.54 KB
#5240 EnrichedLog netcoreapp3.1 3.98μs 2.55ns 9.89ns 0.0218 0 0 1.58 KB
#5240 EnrichedLog net472 4.19μs 2.01ns 7.78ns 0.313 0 0 1.97 KB
Benchmarks.Trace.SpanBenchmark - Faster :tada: Same allocations :heavy_check_mark:

Faster :tada: in #5240

Benchmark base/diff Base Median (ns) Diff Median (ns) Modality
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑netcoreapp3.1 1.303 833.44 639.68
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑net6.0 1.268 584.86 461.19

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartFinishSpan net6.0 585ns 0.524ns 2.03ns 0.00773 0 0 544 B
master StartFinishSpan netcoreapp3.1 833ns 1.81ns 7ns 0.00704 0 0 544 B
master StartFinishSpan net472 755ns 1.83ns 7.08ns 0.0864 0 0 546 B
master StartFinishScope net6.0 652ns 0.822ns 3.18ns 0.00946 0 0 664 B
master StartFinishScope netcoreapp3.1 780ns 1.61ns 6.25ns 0.00893 0 0 664 B
master StartFinishScope net472 984ns 2.35ns 9.08ns 0.0993 0 0 626 B
#5240 StartFinishSpan net6.0 459ns 1.26ns 4.88ns 0.00763 0 0 544 B
#5240 StartFinishSpan netcoreapp3.1 639ns 0.96ns 3.72ns 0.00745 0 0 544 B
#5240 StartFinishSpan net472 721ns 1.22ns 4.72ns 0.0867 0 0 546 B
#5240 StartFinishScope net6.0 650ns 0.816ns 2.94ns 0.00946 0 0 664 B
#5240 StartFinishScope netcoreapp3.1 838ns 2.88ns 11.2ns 0.00917 0 0 664 B
#5240 StartFinishScope net472 953ns 1.66ns 6.45ns 0.0994 0 0 626 B
Benchmarks.Trace.TraceAnnotationsBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunOnMethodBegin net6.0 589ns 1.01ns 3.9ns 0.00924 0 0 664 B
master RunOnMethodBegin netcoreapp3.1 1E+03ns 1.69ns 6.55ns 0.00896 0 0 664 B
master RunOnMethodBegin net472 1.09μs 2.02ns 7.83ns 0.0993 0 0 626 B
#5240 RunOnMethodBegin net6.0 601ns 1.02ns 3.97ns 0.00928 0 0 664 B
#5240 RunOnMethodBegin netcoreapp3.1 1μs 1.72ns 6.68ns 0.00893 0 0 664 B
#5240 RunOnMethodBegin net472 1.1μs 3.01ns 11.7ns 0.099 0 0 626 B

andrewlock avatar Feb 26 '24 19:02 andrewlock

Throughput/Crank Report:zap:

Throughput results for AspNetCoreSimpleController comparing the following branches/commits:

Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red.

Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards!

gantt
    title Throughput Linux x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (5240) (11.808M)   : 0, 11808301
    master (11.782M)   : 0, 11782230
    benchmarks/2.9.0 (12.049M)   : 0, 12048905

    section Automatic
    This PR (5240) (7.906M)   : 0, 7905866
    master (8.000M)   : 0, 7999809
    benchmarks/2.9.0 (8.464M)   : 0, 8463997

    section Trace stats
    master (8.220M)   : 0, 8219910

    section Manual
    This PR (5240) (10.249M)   : 0, 10248571
    master (10.121M)   : 0, 10121081

    section Manual + Automatic
    This PR (5240) (7.548M)   : 0, 7548361
    master (7.401M)   : 0, 7401424

    section Version Conflict
    master (6.682M)   : 0, 6682420


gantt
    title Throughput Linux arm64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (5240) (9.686M)   : 0, 9686363
    master (9.468M)   : 0, 9468472
    benchmarks/2.9.0 (9.590M)   : 0, 9590349

    section Automatic
    This PR (5240) (6.523M)   : 0, 6523266
    master (6.659M)   : 0, 6658834

    section Trace stats
    master (6.910M)   : 0, 6910180

    section Manual
    This PR (5240) (8.138M)   : 0, 8137641
    master (8.171M)   : 0, 8171310

    section Manual + Automatic
    This PR (5240) (6.195M)   : 0, 6194599
    master (6.156M)   : 0, 6155830

    section Version Conflict
    master (5.676M)   : 0, 5675747


gantt
    title Throughput Windows x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (5240) (9.985M)   : 0, 9985256
    master (10.079M)   : 0, 10078999
    benchmarks/2.9.0 (10.465M)   : 0, 10465033

    section Automatic
    This PR (5240) (7.033M)   : 0, 7032997
    master (7.135M)   : 0, 7134788
    benchmarks/2.9.0 (7.635M)   : 0, 7635248

    section Trace stats
    master (7.452M)   : 0, 7451968

    section Manual
    This PR (5240) (8.794M)   : 0, 8794420
    master (8.834M)   : 0, 8833858

    section Manual + Automatic
    This PR (5240) (6.827M)   : 0, 6827429
    master (6.875M)   : 0, 6874694

    section Version Conflict
    master (6.177M)   : 0, 6176958

andrewlock avatar Feb 27 '24 09:02 andrewlock

Benchmarks Report for tracer :snail:

Benchmarks for #5240 compared to master:

  • 1 benchmarks are faster, with geometric mean 1.113
  • 1 benchmarks are slower, with geometric mean 1.125
  • All benchmarks have the same allocations

The following thresholds were used for comparing the benchmark speeds:

  • Mann–Whitney U test with statistical test for significance of 5%
  • Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks.Trace.ActivityBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartStopWithChild net6.0 7.76μs 44.1ns 312ns 0.0147 0.00734 0 5.42 KB
master StartStopWithChild netcoreapp3.1 9.99μs 52.7ns 264ns 0.0254 0.0101 0 5.62 KB
master StartStopWithChild net472 15.8μs 32.9ns 127ns 1.03 0.315 0.102 6.06 KB
#5240 StartStopWithChild net6.0 7.71μs 44.1ns 330ns 0.0164 0.0082 0 5.42 KB
#5240 StartStopWithChild netcoreapp3.1 9.72μs 53.7ns 352ns 0.0146 0.00973 0 5.62 KB
#5240 StartStopWithChild net472 15.8μs 43ns 167ns 1.01 0.287 0.0957 6.07 KB
Benchmarks.Trace.AgentWriterBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 462μs 232ns 898ns 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 628μs 202ns 757ns 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces net472 833μs 560ns 2.17μs 0.417 0 0 3.3 KB
#5240 WriteAndFlushEnrichedTraces net6.0 474μs 339ns 1.31μs 0 0 0 2.7 KB
#5240 WriteAndFlushEnrichedTraces netcoreapp3.1 624μs 334ns 1.25μs 0 0 0 2.7 KB
#5240 WriteAndFlushEnrichedTraces net472 843μs 442ns 1.71μs 0.419 0 0 3.3 KB
Benchmarks.Trace.AspNetCoreBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendRequest net6.0 192μs 1.07μs 6.84μs 0.188 0 0 18.45 KB
master SendRequest netcoreapp3.1 205μs 1.04μs 4.64μs 0.202 0 0 20.61 KB
master SendRequest net472 7.52E‑05ns 5.11E‑05ns 0.000191ns 0 0 0 0 b
#5240 SendRequest net6.0 186μs 1.04μs 6.9μs 0.195 0 0 18.45 KB
#5240 SendRequest netcoreapp3.1 209μs 1.07μs 5.23μs 0.209 0 0 20.61 KB
#5240 SendRequest net472 0ns 0ns 0ns 0 0 0 0 b
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 568μs 1.4μs 5.06μs 0.563 0 0 41.72 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 707μs 2.92μs 10.9μs 0.37 0 0 41.57 KB
master WriteAndFlushEnrichedTraces net472 863μs 3.99μs 16μs 8.08 2.55 0.425 53.31 KB
#5240 WriteAndFlushEnrichedTraces net6.0 567μs 2.66μs 10.3μs 0.568 0 0 41.62 KB
#5240 WriteAndFlushEnrichedTraces netcoreapp3.1 679μs 3.19μs 12.7μs 0.338 0 0 41.74 KB
#5240 WriteAndFlushEnrichedTraces net472 857μs 3.29μs 12.3μs 8.25 2.6 0.434 53.33 KB
Benchmarks.Trace.DbCommandBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteNonQuery net6.0 1.15μs 1.19ns 4.62ns 0.0144 0 0 1.02 KB
master ExecuteNonQuery netcoreapp3.1 1.68μs 1.54ns 5.98ns 0.0133 0 0 1.02 KB
master ExecuteNonQuery net472 2.12μs 1.61ns 6.02ns 0.156 0 0 987 B
#5240 ExecuteNonQuery net6.0 1.21μs 1.02ns 3.96ns 0.0145 0 0 1.02 KB
#5240 ExecuteNonQuery netcoreapp3.1 1.69μs 1.13ns 4.24ns 0.0136 0 0 1.02 KB
#5240 ExecuteNonQuery net472 2.02μs 1.99ns 7.69ns 0.156 0 0 987 B
Benchmarks.Trace.ElasticsearchBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master CallElasticsearch net6.0 1.16μs 0.715ns 2.67ns 0.0139 0 0 976 B
master CallElasticsearch netcoreapp3.1 1.56μs 2.63ns 10.2ns 0.0129 0 0 976 B
master CallElasticsearch net472 2.51μs 1.24ns 4.48ns 0.158 0 0 995 B
master CallElasticsearchAsync net6.0 1.38μs 0.883ns 3.18ns 0.0131 0 0 952 B
master CallElasticsearchAsync netcoreapp3.1 1.68μs 0.742ns 2.67ns 0.0135 0 0 1.02 KB
master CallElasticsearchAsync net472 2.56μs 1.67ns 6.47ns 0.166 0 0 1.05 KB
#5240 CallElasticsearch net6.0 1.24μs 0.677ns 2.53ns 0.0137 0 0 976 B
#5240 CallElasticsearch netcoreapp3.1 1.61μs 0.305ns 1.14ns 0.0129 0 0 976 B
#5240 CallElasticsearch net472 2.57μs 1.87ns 7.24ns 0.158 0 0 995 B
#5240 CallElasticsearchAsync net6.0 1.34μs 0.513ns 1.92ns 0.0134 0 0 952 B
#5240 CallElasticsearchAsync netcoreapp3.1 1.68μs 0.409ns 1.53ns 0.0136 0 0 1.02 KB
#5240 CallElasticsearchAsync net472 2.53μs 1.85ns 7.18ns 0.166 0 0 1.05 KB
Benchmarks.Trace.GraphQLBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteAsync net6.0 1.25μs 0.723ns 2.71ns 0.0132 0 0 952 B
master ExecuteAsync netcoreapp3.1 1.66μs 0.514ns 1.85ns 0.0132 0 0 952 B
master ExecuteAsync net472 1.73μs 1.11ns 4.01ns 0.145 0 0 915 B
#5240 ExecuteAsync net6.0 1.34μs 1.31ns 4.9ns 0.0135 0 0 952 B
#5240 ExecuteAsync netcoreapp3.1 1.52μs 0.615ns 2.3ns 0.013 0 0 952 B
#5240 ExecuteAsync net472 1.75μs 0.463ns 1.79ns 0.145 0.000879 0 915 B
Benchmarks.Trace.HttpClientBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendAsync net6.0 4.2μs 5.33ns 19.2ns 0.0313 0 0 2.22 KB
master SendAsync netcoreapp3.1 5.13μs 1.55ns 6.01ns 0.0358 0 0 2.76 KB
master SendAsync net472 7.8μs 2.89ns 10.8ns 0.496 0 0 3.15 KB
#5240 SendAsync net6.0 4.19μs 1.45ns 5.61ns 0.0315 0 0 2.22 KB
#5240 SendAsync netcoreapp3.1 5.08μs 2.12ns 8.22ns 0.0356 0 0 2.76 KB
#5240 SendAsync net472 7.91μs 1.93ns 7.21ns 0.497 0 0 3.15 KB
Benchmarks.Trace.ILoggerBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 1.57μs 0.436ns 1.57ns 0.0231 0 0 1.64 KB
master EnrichedLog netcoreapp3.1 2.28μs 1.11ns 4.16ns 0.0216 0 0 1.64 KB
master EnrichedLog net472 2.72μs 1.9ns 6.58ns 0.249 0 0 1.57 KB
#5240 EnrichedLog net6.0 1.54μs 0.782ns 2.82ns 0.0229 0 0 1.64 KB
#5240 EnrichedLog netcoreapp3.1 2.19μs 1.08ns 4.2ns 0.0219 0 0 1.64 KB
#5240 EnrichedLog net472 2.7μs 0.892ns 3.09ns 0.249 0 0 1.57 KB
Benchmarks.Trace.Log4netBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 118μs 137ns 531ns 0.0587 0 0 4.28 KB
master EnrichedLog netcoreapp3.1 121μs 163ns 630ns 0.0606 0 0 4.28 KB
master EnrichedLog net472 149μs 190ns 737ns 0.666 0.222 0 4.46 KB
#5240 EnrichedLog net6.0 116μs 178ns 690ns 0.0577 0 0 4.28 KB
#5240 EnrichedLog netcoreapp3.1 121μs 245ns 948ns 0 0 0 4.28 KB
#5240 EnrichedLog net472 149μs 209ns 810ns 0.663 0.221 0 4.46 KB
Benchmarks.Trace.NLogBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 2.92μs 0.766ns 2.97ns 0.0306 0 0 2.2 KB
master EnrichedLog netcoreapp3.1 4.07μs 1.35ns 5.22ns 0.0306 0 0 2.2 KB
master EnrichedLog net472 4.93μs 1.29ns 4.83ns 0.32 0 0 2.02 KB
#5240 EnrichedLog net6.0 3.11μs 1.31ns 5.09ns 0.0295 0 0 2.2 KB
#5240 EnrichedLog netcoreapp3.1 4.18μs 1.66ns 6.21ns 0.0293 0 0 2.2 KB
#5240 EnrichedLog net472 4.98μs 1.23ns 4.59ns 0.318 0 0 2.02 KB
Benchmarks.Trace.RedisBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendReceive net6.0 1.32μs 6.13ns 23.7ns 0.0162 0 0 1.14 KB
master SendReceive netcoreapp3.1 1.76μs 1ns 3.87ns 0.015 0 0 1.14 KB
master SendReceive net472 2.17μs 1.37ns 5.29ns 0.183 0 0 1.16 KB
#5240 SendReceive net6.0 1.32μs 1.14ns 4.43ns 0.0159 0 0 1.14 KB
#5240 SendReceive netcoreapp3.1 1.88μs 1.12ns 4.18ns 0.0148 0 0 1.14 KB
#5240 SendReceive net472 2.26μs 1.77ns 6.63ns 0.183 0 0 1.16 KB
Benchmarks.Trace.SerilogBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 2.75μs 1.18ns 4.56ns 0.0222 0 0 1.6 KB
master EnrichedLog netcoreapp3.1 3.99μs 1.31ns 4.91ns 0.0221 0 0 1.65 KB
master EnrichedLog net472 4.34μs 2.5ns 9.37ns 0.323 0 0 2.04 KB
#5240 EnrichedLog net6.0 2.86μs 0.638ns 2.47ns 0.0214 0 0 1.6 KB
#5240 EnrichedLog netcoreapp3.1 3.77μs 1.81ns 7.02ns 0.0226 0 0 1.65 KB
#5240 EnrichedLog net472 4.57μs 2.28ns 8.54ns 0.322 0 0 2.04 KB
Benchmarks.Trace.SpanBenchmark - Slower :warning: Same allocations :heavy_check_mark:

Slower :warning: in #5240

Benchmark diff/base Base Median (ns) Diff Median (ns) Modality
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑netcoreapp3.1 1.125 561.58 631.84

Faster :tada: in #5240

Benchmark base/diff Base Median (ns) Diff Median (ns) Modality
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑net6.0 1.113 435.23 391.11

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartFinishSpan net6.0 435ns 0.223ns 0.864ns 0.00806 0 0 576 B
master StartFinishSpan netcoreapp3.1 562ns 0.3ns 1.16ns 0.0077 0 0 576 B
master StartFinishSpan net472 656ns 0.493ns 1.91ns 0.0917 0 0 578 B
master StartFinishScope net6.0 484ns 0.281ns 1.01ns 0.00969 0 0 696 B
master StartFinishScope netcoreapp3.1 722ns 0.708ns 2.45ns 0.00944 0 0 696 B
master StartFinishScope net472 840ns 0.732ns 2.83ns 0.104 0 0 658 B
#5240 StartFinishSpan net6.0 391ns 0.296ns 1.15ns 0.00803 0 0 576 B
#5240 StartFinishSpan netcoreapp3.1 632ns 0.312ns 1.17ns 0.00762 0 0 576 B
#5240 StartFinishSpan net472 628ns 0.452ns 1.75ns 0.0918 0 0 578 B
#5240 StartFinishScope net6.0 470ns 0.342ns 1.33ns 0.00986 0 0 696 B
#5240 StartFinishScope netcoreapp3.1 765ns 0.653ns 2.26ns 0.00948 0 0 696 B
#5240 StartFinishScope net472 797ns 0.968ns 3.75ns 0.104 0 0 658 B
Benchmarks.Trace.TraceAnnotationsBenchmark - Same speed :heavy_check_mark: Same allocations :heavy_check_mark:

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunOnMethodBegin net6.0 580ns 0.298ns 1.16ns 0.00985 0 0 696 B
master RunOnMethodBegin netcoreapp3.1 886ns 0.344ns 1.33ns 0.0094 0 0 696 B
master RunOnMethodBegin net472 1.05μs 0.352ns 1.36ns 0.104 0 0 658 B
#5240 RunOnMethodBegin net6.0 602ns 0.45ns 1.74ns 0.00969 0 0 696 B
#5240 RunOnMethodBegin netcoreapp3.1 887ns 0.399ns 1.49ns 0.00942 0 0 696 B
#5240 RunOnMethodBegin net472 1.14μs 1.41ns 5.47ns 0.104 0 0 658 B

andrewlock avatar Mar 19 '24 11:03 andrewlock

Datadog Report

Branch report: chrisnas/support_ssi_telemetry Commit report: d5c9c99 Test service: dd-trace-dotnet

:x: 519 Failed (6 Known Flaky), 330651 Passed, 1703 Skipped, 41m 14.19s Wall Time

:x: Failed Tests (519)

This report shows up to 5 failed tests.

  • ExplicitlyDisableAllocationProfiler - Datadog.Profiler.IntegrationTests.Allocations.AllocationsProfilerTest - Details

    Expand for error 
    xit code of "Samples.Computer01.exe" should be 0 instead of -1073741819 (= 0xC0000005)
xpected: True
ctual:   False

  • ExplicitlyDisableAllocationProfiler - Datadog.Profiler.IntegrationTests.Allocations.AllocationsProfilerTest - Details

    Expand for error 
    xit code of "Samples.Computer01.exe" should be 0 instead of -1073741819 (= 0xC0000005)
xpected: True
ctual:   False

  • MeasureAllocations - Datadog.Profiler.IntegrationTests.Allocations.AllocationsProfilerTest - Details

    Expand for error 
    xit code of "Samples.Computer01.exe" should be 0 instead of -1073741819 (= 0xC0000005)
xpected: True
ctual:   False

  • MeasureAllocations - Datadog.Profiler.IntegrationTests.Allocations.AllocationsProfilerTest - Details

    Expand for error 
    xit code of "Samples.Computer01.exe" should be 0 instead of -1073741819 (= 0xC0000005)
xpected: True
ctual:   False

  • ShouldGetAllocationSamples - Datadog.Profiler.IntegrationTests.Allocations.AllocationsProfilerTest - Details

    Expand for error 
    xit code of "Samples.Computer01.exe" should be 0 instead of -1073741819 (= 0xC0000005)
xpected: True
ctual:   False

datadog-ddstaging[bot] avatar Apr 18 '24 15:04 datadog-ddstaging[bot]

Datadog Report

Branch report: chrisnas/support_ssi_telemetry Commit report: ae9a761 Test service: dd-trace-dotnet

:x: 2 Failed (0 Known Flaky), 345925 Passed, 2379 Skipped, 24h 9m 40.63s Total Time :hourglass: 2 Performance Regressions

:x: Failed Tests (2)

  • CheckSsiAndProfilingSsiEnabled_NoSpan - Datadog.Profiler.IntegrationTests.SingleStepInstrumentation.SingleStepInstrumentationTest - Details

    Expand for error 
    xpected nbProfilesSeries to contain only items satisfying the inspector, but collection is empty.

  • TestSessionTimeoutVulnerability - Datadog.Trace.Security.IntegrationTests.Iast.AspNetCore5IastTestsRestartedSampleIastEnabled - Details

    Expand for error 
    nable to determine port application is listening on

:hourglass: Performance Regressions vs Default Branch (2)

  • Profiler_garbagecollections - scenarios 2.62s (+92.83ms, +4%) - Details
  • Profiler_walltime - scenarios 4.39s (+50.22ms, +1%) - Details

datadog-ddstaging[bot] avatar May 21 '24 13:05 datadog-ddstaging[bot]