dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

Enable telemetry logs by default

Open smola opened this issue 2 years ago • 1 comments
trafficstars

What Does This Do

Enable telemetry log collection by default.

Motivation

Additional Notes

  • Jira ticket: APPSEC-53432
  • Follow up to https://github.com/DataDog/dd-trace-java/pull/6057

smola avatar Nov 16 '23 07:11 smola

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/log-collection-enabled
git_commit_date 1717057189 1717057764
git_commit_sha 608d79214e 2a40c3bb8c
release_version 1.35.0-SNAPSHOT~608d79214e 1.35.0-SNAPSHOT~2a40c3bb8c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1717060502 1717060502
ci_job_id 526900370 526900370
ci_pipeline_id 35432606 35432606
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 48 metrics, 13 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:Telemetry worse
[+204.172µs; +452.300µs] or [+2.689%; +5.957%]
7.921ms 7.593ms
scenario:startup:petclinic:profiling:Telemetry worse
[+293.546µs; +509.665µs] or [+3.958%; +6.872%]
7.818ms 7.417ms
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.35.0-SNAPSHOT~2a40c3bb8c, baseline=1.35.0-SNAPSHOT~608d79214e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1057371
Total [baseline] (10.28 s) : 0, 10280394
Agent [candidate] (1.04 s) : 0, 1040078
Total [candidate] (10.345 s) : 0, 10344642
section appsec
Agent [baseline] (1.174 s) : 0, 1174445
Total [baseline] (10.496 s) : 0, 10495934
Agent [candidate] (1.157 s) : 0, 1156639
Total [candidate] (10.472 s) : 0, 10472474
section iast
Agent [baseline] (1.17 s) : 0, 1169566
Total [baseline] (10.847 s) : 0, 10847126
Agent [candidate] (1.165 s) : 0, 1164717
Total [candidate] (10.886 s) : 0, 10885688
section profiling
Agent [baseline] (1.257 s) : 0, 1256929
Total [baseline] (10.646 s) : 0, 10645817
Agent [candidate] (1.238 s) : 0, 1237530
Total [candidate] (10.671 s) : 0, 10670612
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent appsec 1.174 s 117.074 ms (11.1%)
Agent iast 1.17 s 112.195 ms (10.6%)
Agent profiling 1.257 s 199.558 ms (18.9%)
Total tracing 10.28 s -
Total appsec 10.496 s 215.54 ms (2.1%)
Total iast 10.847 s 566.732 ms (5.5%)
Total profiling 10.646 s 365.423 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.157 s 116.561 ms (11.2%)
Agent iast 1.165 s 124.639 ms (12.0%)
Agent profiling 1.238 s 197.453 ms (19.0%)
Total tracing 10.345 s -
Total appsec 10.472 s 127.832 ms (1.2%)
Total iast 10.886 s 541.045 ms (5.2%)
Total profiling 10.671 s 325.97 ms (3.2%)
gantt
    title petclinic - break down per module: candidate=1.35.0-SNAPSHOT~2a40c3bb8c, baseline=1.35.0-SNAPSHOT~608d79214e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (651.944 ms) : 0, 651944
BytebuddyAgent [candidate] (656.52 ms) : 0, 656520
GlobalTracer [baseline] (312.974 ms) : 0, 312974
GlobalTracer [candidate] (311.863 ms) : 0, 311863
AppSec [baseline] (49.81 ms) : 0, 49810
AppSec [candidate] (49.846 ms) : 0, 49846
Remote Config [baseline] (656.89 µs) : 0, 657
Remote Config [candidate] (662.183 µs) : 0, 662
Telemetry [baseline] (7.635 ms) : 0, 7635
Telemetry [candidate] (7.912 ms) : 0, 7912
section appsec
BytebuddyAgent [baseline] (674.071 ms) : 0, 674071
BytebuddyAgent [candidate] (676.962 ms) : 0, 676962
GlobalTracer [baseline] (295.354 ms) : 0, 295354
GlobalTracer [candidate] (296.105 ms) : 0, 296105
AppSec [baseline] (152.613 ms) : 0, 152613
AppSec [candidate] (152.396 ms) : 0, 152396
Remote Config [baseline] (626.755 µs) : 0, 627
Remote Config [candidate] (634.724 µs) : 0, 635
Telemetry [baseline] (8.098 ms) : 0, 8098
Telemetry [candidate] (7.814 ms) : 0, 7814
IAST [baseline] (18.669 ms) : 0, 18669
IAST [candidate] (18.924 ms) : 0, 18924
section iast
BytebuddyAgent [baseline] (780.462 ms) : 0, 780462
BytebuddyAgent [candidate] (778.256 ms) : 0, 778256
GlobalTracer [baseline] (294.089 ms) : 0, 294089
GlobalTracer [candidate] (292.221 ms) : 0, 292221
AppSec [baseline] (47.235 ms) : 0, 47235
AppSec [candidate] (48.973 ms) : 0, 48973
Remote Config [baseline] (591.083 µs) : 0, 591
Remote Config [candidate] (583.88 µs) : 0, 584
Telemetry [baseline] (7.669 ms) : 0, 7669
Telemetry [candidate] (7.655 ms) : 0, 7655
IAST [baseline] (26.282 ms) : 0, 26282
IAST [candidate] (23.786 ms) : 0, 23786
section profiling
BytebuddyAgent [baseline] (660.814 ms) : 0, 660814
BytebuddyAgent [candidate] (661.518 ms) : 0, 661518
GlobalTracer [baseline] (385.621 ms) : 0, 385621
GlobalTracer [candidate] (384.843 ms) : 0, 384843
AppSec [baseline] (50.392 ms) : 0, 50392
AppSec [candidate] (50.441 ms) : 0, 50441
Remote Config [baseline] (847.052 µs) : 0, 847
Remote Config [candidate] (862.421 µs) : 0, 862
Telemetry [baseline] (7.417 ms) : 0, 7417
Telemetry [candidate] (7.818 ms) : 0, 7818
ProfilingAgent [baseline] (95.375 ms) : 0, 95375
ProfilingAgent [candidate] (96.234 ms) : 0, 96234
Profiling [baseline] (95.399 ms) : 0, 95399
Profiling [candidate] (96.258 ms) : 0, 96258
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.35.0-SNAPSHOT~2a40c3bb8c, baseline=1.35.0-SNAPSHOT~608d79214e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058648
Total [baseline] (8.583 s) : 0, 8583321
Agent [candidate] (1.041 s) : 0, 1040520
Total [candidate] (8.534 s) : 0, 8533656
section iast
Agent [baseline] (1.163 s) : 0, 1162823
Total [baseline] (8.986 s) : 0, 8985608
Agent [candidate] (1.166 s) : 0, 1165590
Total [candidate] (8.983 s) : 0, 8983259
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.168 s) : 0, 1167548
Total [baseline] (8.96 s) : 0, 8959677
Agent [candidate] (1.171 s) : 0, 1171478
Total [candidate] (8.983 s) : 0, 8982772
section iast_TELEMETRY_OFF
Agent [baseline] (1.162 s) : 0, 1162061
Total [baseline] (8.992 s) : 0, 8992271
Agent [candidate] (1.17 s) : 0, 1170199
Total [candidate] (9.0 s) : 0, 9000283
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.163 s 104.175 ms (9.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.168 s 108.9 ms (10.3%)
Agent iast_TELEMETRY_OFF 1.162 s 103.413 ms (9.8%)
Total tracing 8.583 s -
Total iast 8.986 s 402.288 ms (4.7%)
Total iast_HARDCODED_SECRET_DISABLED 8.96 s 376.357 ms (4.4%)
Total iast_TELEMETRY_OFF 8.992 s 408.95 ms (4.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent iast 1.166 s 125.07 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 130.958 ms (12.6%)
Agent iast_TELEMETRY_OFF 1.17 s 129.679 ms (12.5%)
Total tracing 8.534 s -
Total iast 8.983 s 449.603 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.983 s 449.116 ms (5.3%)
Total iast_TELEMETRY_OFF 9.0 s 466.627 ms (5.5%)
gantt
    title insecure-bank - break down per module: candidate=1.35.0-SNAPSHOT~2a40c3bb8c, baseline=1.35.0-SNAPSHOT~608d79214e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (654.599 ms) : 0, 654599
BytebuddyAgent [candidate] (657.14 ms) : 0, 657140
GlobalTracer [baseline] (311.626 ms) : 0, 311626
GlobalTracer [candidate] (311.724 ms) : 0, 311724
AppSec [baseline] (49.652 ms) : 0, 49652
AppSec [candidate] (49.763 ms) : 0, 49763
Remote Config [baseline] (657.427 µs) : 0, 657
Remote Config [candidate] (658.674 µs) : 0, 659
Telemetry [baseline] (7.593 ms) : 0, 7593
Telemetry [candidate] (7.921 ms) : 0, 7921
section iast
BytebuddyAgent [baseline] (776.185 ms) : 0, 776185
BytebuddyAgent [candidate] (777.65 ms) : 0, 777650
GlobalTracer [baseline] (291.214 ms) : 0, 291214
GlobalTracer [candidate] (292.218 ms) : 0, 292218
AppSec [baseline] (49.905 ms) : 0, 49905
AppSec [candidate] (49.727 ms) : 0, 49727
Remote Config [baseline] (605.152 µs) : 0, 605
Remote Config [candidate] (574.968 µs) : 0, 575
Telemetry [baseline] (8.553 ms) : 0, 8553
Telemetry [candidate] (6.843 ms) : 0, 6843
IAST [baseline] (23.18 ms) : 0, 23180
IAST [candidate] (25.33 ms) : 0, 25330
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (780.052 ms) : 0, 780052
BytebuddyAgent [candidate] (782.114 ms) : 0, 782114
GlobalTracer [baseline] (292.123 ms) : 0, 292123
GlobalTracer [candidate] (293.939 ms) : 0, 293939
AppSec [baseline] (49.105 ms) : 0, 49105
AppSec [candidate] (49.844 ms) : 0, 49844
Remote Config [baseline] (587.822 µs) : 0, 588
Remote Config [candidate] (587.552 µs) : 0, 588
Telemetry [baseline] (6.905 ms) : 0, 6905
Telemetry [candidate] (7.596 ms) : 0, 7596
IAST [baseline] (25.437 ms) : 0, 25437
IAST [candidate] (24.057 ms) : 0, 24057
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (775.19 ms) : 0, 775190
BytebuddyAgent [candidate] (780.853 ms) : 0, 780853
GlobalTracer [baseline] (292.322 ms) : 0, 292322
GlobalTracer [candidate] (294.158 ms) : 0, 294158
AppSec [baseline] (51.427 ms) : 0, 51427
AppSec [candidate] (50.803 ms) : 0, 50803
Remote Config [baseline] (584.26 µs) : 0, 584
Remote Config [candidate] (595.407 µs) : 0, 595
Telemetry [baseline] (6.652 ms) : 0, 6652
Telemetry [candidate] (8.246 ms) : 0, 8246
IAST [baseline] (22.601 ms) : 0, 22601
IAST [candidate] (22.119 ms) : 0, 22119

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-05-30T08:45:53 2024-05-30T08:52:41
git_branch master smola/log-collection-enabled
git_commit_date 1717057189 1717057764
git_commit_sha 608d79214e 2a40c3bb8c
release_version 1.35.0-SNAPSHOT~608d79214e 1.35.0-SNAPSHOT~2a40c3bb8c
start_time 2024-05-30T08:45:39 2024-05-30T08:52:28
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1717059506 1717059506
ci_job_id 526900371 526900371
ci_pipeline_id 35432606 35432606
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.35.0-SNAPSHOT~2a40c3bb8c, baseline=1.35.0-SNAPSHOT~608d79214e
    dateFormat X
    axisFormat %s
section baseline
no_agent (366.481 µs) : 346, 387
.   : milestone, 366,
iast (481.153 µs) : 460, 502
.   : milestone, 481,
iast_FULL (553.558 µs) : 532, 575
.   : milestone, 554,
iast_GLOBAL (511.515 µs) : 489, 534
.   : milestone, 512,
iast_HARDCODED_SECRET_DISABLED (479.434 µs) : 459, 500
.   : milestone, 479,
iast_INACTIVE (453.348 µs) : 432, 474
.   : milestone, 453,
iast_TELEMETRY_OFF (480.742 µs) : 459, 503
.   : milestone, 481,
tracing (446.574 µs) : 425, 468
.   : milestone, 447,
section candidate
no_agent (371.016 µs) : 351, 391
.   : milestone, 371,
iast (472.491 µs) : 452, 493
.   : milestone, 472,
iast_FULL (549.099 µs) : 528, 570
.   : milestone, 549,
iast_GLOBAL (504.232 µs) : 482, 526
.   : milestone, 504,
iast_HARDCODED_SECRET_DISABLED (478.008 µs) : 457, 499
.   : milestone, 478,
iast_INACTIVE (452.873 µs) : 432, 474
.   : milestone, 453,
iast_TELEMETRY_OFF (474.596 µs) : 453, 496
.   : milestone, 475,
tracing (442.619 µs) : 422, 464
.   : milestone, 443,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 366.481 µs [346.34 µs, 386.621 µs] -
iast 481.153 µs [460.164 µs, 502.141 µs] 114.672 µs (31.3%)
iast_FULL 553.558 µs [532.356 µs, 574.76 µs] 187.077 µs (51.0%)
iast_GLOBAL 511.515 µs [488.991 µs, 534.039 µs] 145.034 µs (39.6%)
iast_HARDCODED_SECRET_DISABLED 479.434 µs [458.598 µs, 500.27 µs] 112.953 µs (30.8%)
iast_INACTIVE 453.348 µs [432.25 µs, 474.445 µs] 86.867 µs (23.7%)
iast_TELEMETRY_OFF 480.742 µs [458.705 µs, 502.779 µs] 114.261 µs (31.2%)
tracing 446.574 µs [424.997 µs, 468.151 µs] 80.093 µs (21.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.016 µs [350.816 µs, 391.215 µs] -
iast 472.491 µs [451.648 µs, 493.334 µs] 101.475 µs (27.4%)
iast_FULL 549.099 µs [527.833 µs, 570.365 µs] 178.084 µs (48.0%)
iast_GLOBAL 504.232 µs [482.398 µs, 526.067 µs] 133.217 µs (35.9%)
iast_HARDCODED_SECRET_DISABLED 478.008 µs [456.926 µs, 499.09 µs] 106.992 µs (28.8%)
iast_INACTIVE 452.873 µs [431.505 µs, 474.242 µs] 81.858 µs (22.1%)
iast_TELEMETRY_OFF 474.596 µs [453.328 µs, 495.864 µs] 103.58 µs (27.9%)
tracing 442.619 µs [421.583 µs, 463.655 µs] 71.603 µs (19.3%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.35.0-SNAPSHOT~2a40c3bb8c, baseline=1.35.0-SNAPSHOT~608d79214e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.327 ms) : 1307, 1348
.   : milestone, 1327,
appsec (1.711 ms) : 1687, 1734
.   : milestone, 1711,
appsec_no_iast (1.735 ms) : 1711, 1760
.   : milestone, 1735,
iast (1.506 ms) : 1482, 1529
.   : milestone, 1506,
profiling (1.494 ms) : 1470, 1518
.   : milestone, 1494,
tracing (1.465 ms) : 1441, 1489
.   : milestone, 1465,
section candidate
no_agent (1.358 ms) : 1339, 1378
.   : milestone, 1358,
appsec (1.713 ms) : 1689, 1738
.   : milestone, 1713,
appsec_no_iast (1.714 ms) : 1689, 1739
.   : milestone, 1714,
iast (1.477 ms) : 1454, 1500
.   : milestone, 1477,
profiling (1.479 ms) : 1454, 1504
.   : milestone, 1479,
tracing (1.475 ms) : 1451, 1498
.   : milestone, 1475,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.327 ms [1.307 ms, 1.348 ms] -
appsec 1.711 ms [1.687 ms, 1.734 ms] 383.067 µs (28.9%)
appsec_no_iast 1.735 ms [1.711 ms, 1.76 ms] 407.93 µs (30.7%)
iast 1.506 ms [1.482 ms, 1.529 ms] 178.277 µs (13.4%)
profiling 1.494 ms [1.47 ms, 1.518 ms] 166.309 µs (12.5%)
tracing 1.465 ms [1.441 ms, 1.489 ms] 137.655 µs (10.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.358 ms [1.339 ms, 1.378 ms] -
appsec 1.713 ms [1.689 ms, 1.738 ms] 355.248 µs (26.2%)
appsec_no_iast 1.714 ms [1.689 ms, 1.739 ms] 355.811 µs (26.2%)
iast 1.477 ms [1.454 ms, 1.5 ms] 118.518 µs (8.7%)
profiling 1.479 ms [1.454 ms, 1.504 ms] 120.397 µs (8.9%)
tracing 1.475 ms [1.451 ms, 1.498 ms] 116.635 µs (8.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/log-collection-enabled
git_commit_date 1717057189 1717057764
git_commit_sha 608d79214e 2a40c3bb8c
release_version 1.35.0-SNAPSHOT~608d79214e 1.35.0-SNAPSHOT~2a40c3bb8c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1717060033 1717060033
ci_job_id 526900372 526900372
ci_pipeline_id 35432606 35432606
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.35.0-SNAPSHOT~2a40c3bb8c, baseline=1.35.0-SNAPSHOT~608d79214e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.077 s) : 15077000, 15077000
.   : milestone, 15077000,
appsec (14.999 s) : 14999000, 14999000
.   : milestone, 14999000,
iast (18.933 s) : 18933000, 18933000
.   : milestone, 18933000,
iast_GLOBAL (17.93 s) : 17930000, 17930000
.   : milestone, 17930000,
profiling (15.057 s) : 15057000, 15057000
.   : milestone, 15057000,
tracing (15.115 s) : 15115000, 15115000
.   : milestone, 15115000,
section candidate
no_agent (15.485 s) : 15485000, 15485000
.   : milestone, 15485000,
appsec (15.246 s) : 15246000, 15246000
.   : milestone, 15246000,
iast (18.94 s) : 18940000, 18940000
.   : milestone, 18940000,
iast_GLOBAL (17.987 s) : 17987000, 17987000
.   : milestone, 17987000,
profiling (14.779 s) : 14779000, 14779000
.   : milestone, 14779000,
tracing (15.026 s) : 15026000, 15026000
.   : milestone, 15026000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.077 s [15.077 s, 15.077 s] -
appsec 14.999 s [14.999 s, 14.999 s] -78.0 ms (-0.5%)
iast 18.933 s [18.933 s, 18.933 s] 3.856 s (25.6%)
iast_GLOBAL 17.93 s [17.93 s, 17.93 s] 2.853 s (18.9%)
profiling 15.057 s [15.057 s, 15.057 s] -20.0 ms (-0.1%)
tracing 15.115 s [15.115 s, 15.115 s] 38.0 ms (0.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.485 s [15.485 s, 15.485 s] -
appsec 15.246 s [15.246 s, 15.246 s] -239.0 ms (-1.5%)
iast 18.94 s [18.94 s, 18.94 s] 3.455 s (22.3%)
iast_GLOBAL 17.987 s [17.987 s, 17.987 s] 2.502 s (16.2%)
profiling 14.779 s [14.779 s, 14.779 s] -706.0 ms (-4.6%)
tracing 15.026 s [15.026 s, 15.026 s] -459.0 ms (-3.0%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.35.0-SNAPSHOT~2a40c3bb8c, baseline=1.35.0-SNAPSHOT~608d79214e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.457 ms) : 1445, 1468
.   : milestone, 1457,
appsec (2.187 ms) : 2152, 2221
.   : milestone, 2187,
iast (1.958 ms) : 1917, 2000
.   : milestone, 1958,
iast_GLOBAL (2.003 ms) : 1962, 2045
.   : milestone, 2003,
profiling (1.828 ms) : 1794, 1861
.   : milestone, 1828,
tracing (1.819 ms) : 1787, 1851
.   : milestone, 1819,
section candidate
no_agent (1.457 ms) : 1446, 1469
.   : milestone, 1457,
appsec (2.188 ms) : 2153, 2222
.   : milestone, 2188,
iast (1.955 ms) : 1914, 1996
.   : milestone, 1955,
iast_GLOBAL (1.994 ms) : 1954, 2035
.   : milestone, 1994,
profiling (1.843 ms) : 1808, 1877
.   : milestone, 1843,
tracing (1.821 ms) : 1789, 1853
.   : milestone, 1821,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.457 ms [1.445 ms, 1.468 ms] -
appsec 2.187 ms [2.152 ms, 2.221 ms] 729.879 µs (50.1%)
iast 1.958 ms [1.917 ms, 2.0 ms] 501.483 µs (34.4%)
iast_GLOBAL 2.003 ms [1.962 ms, 2.045 ms] 546.535 µs (37.5%)
profiling 1.828 ms [1.794 ms, 1.861 ms] 371.079 µs (25.5%)
tracing 1.819 ms [1.787 ms, 1.851 ms] 362.02 µs (24.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.457 ms [1.446 ms, 1.469 ms] -
appsec 2.188 ms [2.153 ms, 2.222 ms] 730.189 µs (50.1%)
iast 1.955 ms [1.914 ms, 1.996 ms] 497.399 µs (34.1%)
iast_GLOBAL 1.994 ms [1.954 ms, 2.035 ms] 537.005 µs (36.8%)
profiling 1.843 ms [1.808 ms, 1.877 ms] 385.287 µs (26.4%)
tracing 1.821 ms [1.789 ms, 1.853 ms] 363.875 µs (25.0%)

pr-commenter[bot] avatar Nov 16 '23 08:11 pr-commenter[bot]