dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

Published 20 hours ago • verified publisher icon DataDog

Split remote configuration API into a dedicated module

Open PerfectSlayer opened this issue 1 year ago • 1 comments

What Does This Do

This PR introduces new API (ConfigKey, Capabilities, ConfigurationPoller) and move the existing ones into a dedicated module. It also moves SizeCheckedInputStream into common api as used by both remote-config and agent-debugger

Motivation

This is an experimental PR to play with api vs implementation separation, applied to the remote-config component as example.

Additional Notes

Jira ticket: [PROJ-IDENT]

PerfectSlayer avatar Apr 12 '24 13:04 PerfectSlayer

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/arch
git_commit_date 1718966972 1718972602
git_commit_sha 901334b037 152c8f4bcd
release_version 1.36.0-SNAPSHOT~901334b037 1.36.0-SNAPSHOT~152c8f4bcd
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718975596 1718975596
ci_job_id 550201354 550201354
ci_pipeline_id 37282830 37282830
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:appsec:Remote Config better
[-54.833µs; -17.776µs] or [-8.484%; -2.750%]		 610.011µs 646.315µs
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~152c8f4bcd, baseline=1.36.0-SNAPSHOT~901334b037

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1060849
Total [baseline] (10.321 s) : 0, 10320585
Agent [candidate] (1.07 s) : 0, 1069592
Total [candidate] (10.376 s) : 0, 10375782
section appsec
Agent [baseline] (1.187 s) : 0, 1186566
Total [baseline] (10.493 s) : 0, 10492719
Agent [candidate] (1.19 s) : 0, 1190378
Total [candidate] (10.473 s) : 0, 10472823
section iast
Agent [baseline] (1.171 s) : 0, 1170535
Total [baseline] (10.693 s) : 0, 10692750
Agent [candidate] (1.17 s) : 0, 1170168
Total [candidate] (10.719 s) : 0, 10719049
section profiling
Agent [baseline] (1.26 s) : 0, 1260239
Total [baseline] (10.648 s) : 0, 10647509
Agent [candidate] (1.261 s) : 0, 1260873
Total [candidate] (10.717 s) : 0, 10716816
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent appsec 1.187 s 125.717 ms (11.9%)
Agent iast 1.171 s 109.686 ms (10.3%)
Agent profiling 1.26 s 199.39 ms (18.8%)
Total tracing 10.321 s -
Total appsec 10.493 s 172.134 ms (1.7%)
Total iast 10.693 s 372.166 ms (3.6%)
Total profiling 10.648 s 326.924 ms (3.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent appsec 1.19 s 120.786 ms (11.3%)
Agent iast 1.17 s 100.576 ms (9.4%)
Agent profiling 1.261 s 191.281 ms (17.9%)
Total tracing 10.376 s -
Total appsec 10.473 s 97.041 ms (0.9%)
Total iast 10.719 s 343.267 ms (3.3%)
Total profiling 10.717 s 341.034 ms (3.3%) 
gantt
    title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~152c8f4bcd, baseline=1.36.0-SNAPSHOT~901334b037

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (664.528 ms) : 0, 664528
BytebuddyAgent [candidate] (670.569 ms) : 0, 670569
GlobalTracer [baseline] (303.295 ms) : 0, 303295
GlobalTracer [candidate] (305.212 ms) : 0, 305212
AppSec [baseline] (50.183 ms) : 0, 50183
AppSec [candidate] (50.759 ms) : 0, 50759
Remote Config [baseline] (688.883 µs) : 0, 689
Remote Config [candidate] (676.182 µs) : 0, 676
Telemetry [baseline] (7.683 ms) : 0, 7683
Telemetry [candidate] (7.574 ms) : 0, 7574
section appsec
BytebuddyAgent [baseline] (678.658 ms) : 0, 678658
BytebuddyAgent [candidate] (681.004 ms) : 0, 681004
GlobalTracer [baseline] (298.123 ms) : 0, 298123
GlobalTracer [candidate] (298.507 ms) : 0, 298507
AppSec [baseline] (154.445 ms) : 0, 154445
AppSec [candidate] (155.246 ms) : 0, 155246
Remote Config [baseline] (646.315 µs) : 0, 646
Remote Config [candidate] (610.011 µs) : 0, 610
Telemetry [baseline] (9.152 ms) : 0, 9152
Telemetry [candidate] (9.484 ms) : 0, 9484
IAST [baseline] (21.812 ms) : 0, 21812
IAST [candidate] (21.344 ms) : 0, 21344
section iast
BytebuddyAgent [baseline] (780.663 ms) : 0, 780663
BytebuddyAgent [candidate] (779.605 ms) : 0, 779605
GlobalTracer [baseline] (293.311 ms) : 0, 293311
GlobalTracer [candidate] (293.454 ms) : 0, 293454
AppSec [baseline] (47.376 ms) : 0, 47376
AppSec [candidate] (47.5 ms) : 0, 47500
Remote Config [baseline] (665.712 µs) : 0, 666
Remote Config [candidate] (592.945 µs) : 0, 593
Telemetry [baseline] (6.967 ms) : 0, 6967
Telemetry [candidate] (6.933 ms) : 0, 6933
IAST [baseline] (28.17 ms) : 0, 28170
IAST [candidate] (28.597 ms) : 0, 28597
section profiling
BytebuddyAgent [baseline] (661.797 ms) : 0, 661797
BytebuddyAgent [candidate] (662.172 ms) : 0, 662172
GlobalTracer [baseline] (385.907 ms) : 0, 385907
GlobalTracer [candidate] (385.554 ms) : 0, 385554
AppSec [baseline] (51.276 ms) : 0, 51276
AppSec [candidate] (51.655 ms) : 0, 51655
Remote Config [baseline] (735.953 µs) : 0, 736
Remote Config [candidate] (723.117 µs) : 0, 723
Telemetry [baseline] (7.367 ms) : 0, 7367
Telemetry [candidate] (7.361 ms) : 0, 7361
ProfilingAgent [baseline] (96.047 ms) : 0, 96047
ProfilingAgent [candidate] (96.309 ms) : 0, 96309
Profiling [baseline] (96.072 ms) : 0, 96072
Profiling [candidate] (96.334 ms) : 0, 96334
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~152c8f4bcd, baseline=1.36.0-SNAPSHOT~901334b037

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1070221
Total [baseline] (8.597 s) : 0, 8597352
Agent [candidate] (1.061 s) : 0, 1060934
Total [candidate] (8.538 s) : 0, 8537628
section iast
Agent [baseline] (1.169 s) : 0, 1169173
Total [baseline] (9.02 s) : 0, 9020238
Agent [candidate] (1.169 s) : 0, 1169463
Total [candidate] (9.013 s) : 0, 9013190
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.169 s) : 0, 1168628
Total [baseline] (9.002 s) : 0, 9002299
Agent [candidate] (1.171 s) : 0, 1170767
Total [candidate] (8.958 s) : 0, 8958489
section iast_TELEMETRY_OFF
Agent [baseline] (1.164 s) : 0, 1164312
Total [baseline] (9.009 s) : 0, 9009331
Agent [candidate] (1.17 s) : 0, 1170476
Total [candidate] (9.002 s) : 0, 9002487
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent iast 1.169 s 98.952 ms (9.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.169 s 98.407 ms (9.2%)
Agent iast_TELEMETRY_OFF 1.164 s 94.091 ms (8.8%)
Total tracing 8.597 s -
Total iast 9.02 s 422.886 ms (4.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.002 s 404.947 ms (4.7%)
Total iast_TELEMETRY_OFF 9.009 s 411.98 ms (4.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.169 s 108.529 ms (10.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 109.833 ms (10.4%)
Agent iast_TELEMETRY_OFF 1.17 s 109.542 ms (10.3%)
Total tracing 8.538 s -
Total iast 9.013 s 475.562 ms (5.6%)
Total iast_HARDCODED_SECRET_DISABLED 8.958 s 420.861 ms (4.9%)
Total iast_TELEMETRY_OFF 9.002 s 464.859 ms (5.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~152c8f4bcd, baseline=1.36.0-SNAPSHOT~901334b037

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.637 ms) : 0, 670637
BytebuddyAgent [candidate] (664.431 ms) : 0, 664431
GlobalTracer [baseline] (305.87 ms) : 0, 305870
GlobalTracer [candidate] (303.096 ms) : 0, 303096
AppSec [baseline] (50.753 ms) : 0, 50753
AppSec [candidate] (50.674 ms) : 0, 50674
Remote Config [baseline] (695.17 µs) : 0, 695
Remote Config [candidate] (677.279 µs) : 0, 677
Telemetry [baseline] (7.629 ms) : 0, 7629
Telemetry [candidate] (7.563 ms) : 0, 7563
section iast
BytebuddyAgent [baseline] (780.643 ms) : 0, 780643
BytebuddyAgent [candidate] (778.99 ms) : 0, 778990
GlobalTracer [baseline] (293.786 ms) : 0, 293786
GlobalTracer [candidate] (292.953 ms) : 0, 292953
AppSec [baseline] (47.166 ms) : 0, 47166
AppSec [candidate] (47.343 ms) : 0, 47343
IAST [baseline] (25.223 ms) : 0, 25223
IAST [candidate] (29.112 ms) : 0, 29112
Remote Config [baseline] (598.155 µs) : 0, 598
Remote Config [candidate] (665.329 µs) : 0, 665
Telemetry [baseline] (8.46 ms) : 0, 8460
Telemetry [candidate] (6.941 ms) : 0, 6941
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (778.59 ms) : 0, 778590
BytebuddyAgent [candidate] (780.546 ms) : 0, 780546
GlobalTracer [baseline] (293.499 ms) : 0, 293499
GlobalTracer [candidate] (294.056 ms) : 0, 294056
AppSec [baseline] (47.277 ms) : 0, 47277
AppSec [candidate] (47.649 ms) : 0, 47649
IAST [baseline] (27.409 ms) : 0, 27409
IAST [candidate] (27.328 ms) : 0, 27328
Remote Config [baseline] (679.938 µs) : 0, 680
Remote Config [candidate] (665.566 µs) : 0, 666
Telemetry [baseline] (7.831 ms) : 0, 7831
Telemetry [candidate] (7.02 ms) : 0, 7020
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (777.131 ms) : 0, 777131
BytebuddyAgent [candidate] (781.198 ms) : 0, 781198
GlobalTracer [baseline] (293.455 ms) : 0, 293455
GlobalTracer [candidate] (292.895 ms) : 0, 292895
AppSec [baseline] (46.916 ms) : 0, 46916
AppSec [candidate] (47.409 ms) : 0, 47409
IAST [baseline] (25.327 ms) : 0, 25327
IAST [candidate] (26.389 ms) : 0, 26389
Remote Config [baseline] (582.634 µs) : 0, 583
Remote Config [candidate] (583.909 µs) : 0, 584
Telemetry [baseline] (7.594 ms) : 0, 7594
Telemetry [candidate] (8.424 ms) : 0, 8424

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-21T12:44:03 2024-06-21T12:50:52
git_branch master bbujon/arch
git_commit_date 1718966972 1718972602
git_commit_sha 901334b037 152c8f4bcd
release_version 1.36.0-SNAPSHOT~901334b037 1.36.0-SNAPSHOT~152c8f4bcd
start_time 2024-06-21T12:43:49 2024-06-21T12:50:38
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718974596 1718974596
ci_job_id 550201355 550201355
ci_pipeline_id 37282830 37282830
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~152c8f4bcd, baseline=1.36.0-SNAPSHOT~901334b037
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.352 ms) : 1333, 1371
.   : milestone, 1352,
appsec (1.715 ms) : 1691, 1739
.   : milestone, 1715,
appsec_no_iast (1.711 ms) : 1687, 1736
.   : milestone, 1711,
iast (1.476 ms) : 1454, 1499
.   : milestone, 1476,
profiling (1.48 ms) : 1455, 1504
.   : milestone, 1480,
tracing (1.473 ms) : 1448, 1497
.   : milestone, 1473,
section candidate
no_agent (1.345 ms) : 1326, 1365
.   : milestone, 1345,
appsec (1.705 ms) : 1681, 1730
.   : milestone, 1705,
appsec_no_iast (1.697 ms) : 1672, 1722
.   : milestone, 1697,
iast (1.483 ms) : 1460, 1506
.   : milestone, 1483,
profiling (1.477 ms) : 1453, 1502
.   : milestone, 1477,
tracing (1.486 ms) : 1462, 1509
.   : milestone, 1486,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.352 ms [1.333 ms, 1.371 ms] -
appsec 1.715 ms [1.691 ms, 1.739 ms] 363.436 µs (26.9%)
appsec_no_iast 1.711 ms [1.687 ms, 1.736 ms] 359.632 µs (26.6%)
iast 1.476 ms [1.454 ms, 1.499 ms] 124.754 µs (9.2%)
profiling 1.48 ms [1.455 ms, 1.504 ms] 128.19 µs (9.5%)
tracing 1.473 ms [1.448 ms, 1.497 ms] 120.789 µs (8.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.345 ms [1.326 ms, 1.365 ms] -
appsec 1.705 ms [1.681 ms, 1.73 ms] 359.694 µs (26.7%)
appsec_no_iast 1.697 ms [1.672 ms, 1.722 ms] 351.677 µs (26.1%)
iast 1.483 ms [1.46 ms, 1.506 ms] 137.398 µs (10.2%)
profiling 1.477 ms [1.453 ms, 1.502 ms] 131.838 µs (9.8%)
tracing 1.486 ms [1.462 ms, 1.509 ms] 140.17 µs (10.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~152c8f4bcd, baseline=1.36.0-SNAPSHOT~901334b037
    dateFormat X
    axisFormat %s
section baseline
no_agent (372.257 µs) : 352, 393
.   : milestone, 372,
iast (481.796 µs) : 460, 503
.   : milestone, 482,
iast_FULL (546.516 µs) : 526, 567
.   : milestone, 547,
iast_GLOBAL (507.449 µs) : 486, 529
.   : milestone, 507,
iast_HARDCODED_SECRET_DISABLED (484.387 µs) : 463, 506
.   : milestone, 484,
iast_INACTIVE (451.149 µs) : 430, 472
.   : milestone, 451,
iast_TELEMETRY_OFF (469.965 µs) : 449, 491
.   : milestone, 470,
tracing (435.067 µs) : 415, 455
.   : milestone, 435,
section candidate
no_agent (369.847 µs) : 351, 389
.   : milestone, 370,
iast (486.471 µs) : 465, 507
.   : milestone, 486,
iast_FULL (548.33 µs) : 527, 569
.   : milestone, 548,
iast_GLOBAL (504.642 µs) : 483, 526
.   : milestone, 505,
iast_HARDCODED_SECRET_DISABLED (487.17 µs) : 465, 509
.   : milestone, 487,
iast_INACTIVE (447.527 µs) : 427, 469
.   : milestone, 448,
iast_TELEMETRY_OFF (470.991 µs) : 449, 493
.   : milestone, 471,
tracing (439.562 µs) : 419, 461
.   : milestone, 440,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.257 µs [351.861 µs, 392.653 µs] -
iast 481.796 µs [460.388 µs, 503.205 µs] 109.539 µs (29.4%)
iast_FULL 546.516 µs [525.581 µs, 567.452 µs] 174.259 µs (46.8%)
iast_GLOBAL 507.449 µs [485.848 µs, 529.05 µs] 135.191 µs (36.3%)
iast_HARDCODED_SECRET_DISABLED 484.387 µs [463.205 µs, 505.57 µs] 112.13 µs (30.1%)
iast_INACTIVE 451.149 µs [430.147 µs, 472.151 µs] 78.892 µs (21.2%)
iast_TELEMETRY_OFF 469.965 µs [449.027 µs, 490.904 µs] 97.708 µs (26.2%)
tracing 435.067 µs [415.249 µs, 454.884 µs] 62.809 µs (16.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 369.847 µs [350.531 µs, 389.164 µs] -
iast 486.471 µs [465.471 µs, 507.472 µs] 116.624 µs (31.5%)
iast_FULL 548.33 µs [527.417 µs, 569.243 µs] 178.483 µs (48.3%)
iast_GLOBAL 504.642 µs [483.06 µs, 526.224 µs] 134.795 µs (36.4%)
iast_HARDCODED_SECRET_DISABLED 487.17 µs [465.498 µs, 508.841 µs] 117.322 µs (31.7%)
iast_INACTIVE 447.527 µs [426.544 µs, 468.509 µs] 77.679 µs (21.0%)
iast_TELEMETRY_OFF 470.991 µs [449.451 µs, 492.532 µs] 101.144 µs (27.3%)
tracing 439.562 µs [418.602 µs, 460.521 µs] 69.714 µs (18.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/arch
git_commit_date 1718966972 1718972602
git_commit_sha 901334b037 152c8f4bcd
release_version 1.36.0-SNAPSHOT~901334b037 1.36.0-SNAPSHOT~152c8f4bcd
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1718975095 1718975095
ci_job_id 550201356 550201356
ci_pipeline_id 37282830 37282830
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~152c8f4bcd, baseline=1.36.0-SNAPSHOT~901334b037
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.632 s) : 15632000, 15632000
.   : milestone, 15632000,
appsec (14.815 s) : 14815000, 14815000
.   : milestone, 14815000,
iast (18.849 s) : 18849000, 18849000
.   : milestone, 18849000,
iast_GLOBAL (17.688 s) : 17688000, 17688000
.   : milestone, 17688000,
profiling (15.424 s) : 15424000, 15424000
.   : milestone, 15424000,
tracing (15.115 s) : 15115000, 15115000
.   : milestone, 15115000,
section candidate
no_agent (15.004 s) : 15004000, 15004000
.   : milestone, 15004000,
appsec (15.155 s) : 15155000, 15155000
.   : milestone, 15155000,
iast (19.026 s) : 19026000, 19026000
.   : milestone, 19026000,
iast_GLOBAL (17.889 s) : 17889000, 17889000
.   : milestone, 17889000,
profiling (15.185 s) : 15185000, 15185000
.   : milestone, 15185000,
tracing (14.75 s) : 14750000, 14750000
.   : milestone, 14750000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.632 s [15.632 s, 15.632 s] -
appsec 14.815 s [14.815 s, 14.815 s] -817.0 ms (-5.2%)
iast 18.849 s [18.849 s, 18.849 s] 3.217 s (20.6%)
iast_GLOBAL 17.688 s [17.688 s, 17.688 s] 2.056 s (13.2%)
profiling 15.424 s [15.424 s, 15.424 s] -208.0 ms (-1.3%)
tracing 15.115 s [15.115 s, 15.115 s] -517.0 ms (-3.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.004 s [15.004 s, 15.004 s] -
appsec 15.155 s [15.155 s, 15.155 s] 151.0 ms (1.0%)
iast 19.026 s [19.026 s, 19.026 s] 4.022 s (26.8%)
iast_GLOBAL 17.889 s [17.889 s, 17.889 s] 2.885 s (19.2%)
profiling 15.185 s [15.185 s, 15.185 s] 181.0 ms (1.2%)
tracing 14.75 s [14.75 s, 14.75 s] -254.0 ms (-1.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~152c8f4bcd, baseline=1.36.0-SNAPSHOT~901334b037
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.463 ms) : 1452, 1475
.   : milestone, 1463,
appsec (2.211 ms) : 2176, 2245
.   : milestone, 2211,
iast (1.967 ms) : 1926, 2009
.   : milestone, 1967,
iast_GLOBAL (2.024 ms) : 1982, 2066
.   : milestone, 2024,
profiling (1.855 ms) : 1822, 1889
.   : milestone, 1855,
tracing (1.837 ms) : 1804, 1869
.   : milestone, 1837,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.215 ms) : 2180, 2249
.   : milestone, 2215,
iast (1.968 ms) : 1927, 2010
.   : milestone, 1968,
iast_GLOBAL (2.019 ms) : 1977, 2061
.   : milestone, 2019,
profiling (1.852 ms) : 1819, 1885
.   : milestone, 1852,
tracing (1.849 ms) : 1817, 1881
.   : milestone, 1849,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.463 ms [1.452 ms, 1.475 ms] -
appsec 2.211 ms [2.176 ms, 2.245 ms] 747.379 µs (51.1%)
iast 1.967 ms [1.926 ms, 2.009 ms] 503.916 µs (34.4%)
iast_GLOBAL 2.024 ms [1.982 ms, 2.066 ms] 560.672 µs (38.3%)
profiling 1.855 ms [1.822 ms, 1.889 ms] 392.12 µs (26.8%)
tracing 1.837 ms [1.804 ms, 1.869 ms] 373.746 µs (25.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.215 ms [2.18 ms, 2.249 ms] 743.815 µs (50.6%)
iast 1.968 ms [1.927 ms, 2.01 ms] 497.604 µs (33.8%)
iast_GLOBAL 2.019 ms [1.977 ms, 2.061 ms] 548.132 µs (37.3%)
profiling 1.852 ms [1.819 ms, 1.885 ms] 381.18 µs (25.9%)
tracing 1.849 ms [1.817 ms, 1.881 ms] 377.927 µs (25.7%)

pr-commenter[bot] avatar Apr 12 '24 14:04 pr-commenter[bot]