Update Configuration Docs with V2 Format

Open mhlidd opened this issue 3 weeks ago • 1 comments

What Does This Do

This PR updates the existing add_new_configuration.md docs to include information about the V2 format.

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

Dec 12 '25 18:12 mhlidd

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/update_config_docs
git_commit_date	1765554521	1765563969
git_commit_sha	1ad22e707a	33839e976b
release_version	1.57.0-SNAPSHOT~1ad22e707a	1.57.0-SNAPSHOT~33839e976b

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1765565844	1765565844
ci_job_id	1291829826	1291829826
ci_pipeline_id	86549194	86549194
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-1scrhag8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-1scrhag8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 7 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~33839e976b, baseline=1.57.0-SNAPSHOT~1ad22e707a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1081448
Total [baseline] (8.787 s) : 0, 8786521
Agent [candidate] (1.081 s) : 0, 1081450
Total [candidate] (8.731 s) : 0, 8730581
section iast
Agent [baseline] (1.231 s) : 0, 1230626
Total [baseline] (9.404 s) : 0, 9403574
Agent [candidate] (1.222 s) : 0, 1221575
Total [candidate] (9.391 s) : 0, 9391419

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.081 s	-
Agent	iast	1.231 s	149.178 ms (13.8%)
Total	tracing	8.787 s	-
Total	iast	9.404 s	617.053 ms (7.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.081 s	-
Agent	iast	1.222 s	140.125 ms (13.0%)
Total	tracing	8.731 s	-
Total	iast	9.391 s	660.838 ms (7.6%)

gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~33839e976b, baseline=1.57.0-SNAPSHOT~1ad22e707a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (649.519 ms) : 0, 649519
BytebuddyAgent [candidate] (649.421 ms) : 0, 649421
GlobalTracer [baseline] (281.815 ms) : 0, 281815
GlobalTracer [candidate] (282.121 ms) : 0, 282121
AppSec [baseline] (32.419 ms) : 0, 32419
AppSec [candidate] (32.35 ms) : 0, 32350
Debugger [baseline] (67.654 ms) : 0, 67654
Debugger [candidate] (67.601 ms) : 0, 67601
Remote Config [baseline] (624.666 µs) : 0, 625
Remote Config [candidate] (623.296 µs) : 0, 623
Telemetry [baseline] (8.995 ms) : 0, 8995
Telemetry [candidate] (8.977 ms) : 0, 8977
Flare Poller [baseline] (3.744 ms) : 0, 3744
Flare Poller [candidate] (3.759 ms) : 0, 3759
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (797.348 ms) : 0, 797348
BytebuddyAgent [candidate] (790.653 ms) : 0, 790653
GlobalTracer [baseline] (257.247 ms) : 0, 257247
GlobalTracer [candidate] (255.526 ms) : 0, 255526
IAST [baseline] (27.103 ms) : 0, 27103
IAST [candidate] (26.849 ms) : 0, 26849
AppSec [baseline] (34.486 ms) : 0, 34486
AppSec [candidate] (32.723 ms) : 0, 32723
Debugger [baseline] (65.138 ms) : 0, 65138
Debugger [candidate] (66.71 ms) : 0, 66710
Remote Config [baseline] (551.237 µs) : 0, 551
Remote Config [candidate] (542.427 µs) : 0, 542
Telemetry [baseline] (8.444 ms) : 0, 8444
Telemetry [candidate] (8.459 ms) : 0, 8459
Flare Poller [baseline] (3.528 ms) : 0, 3528
Flare Poller [candidate] (3.499 ms) : 0, 3499

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~33839e976b, baseline=1.57.0-SNAPSHOT~1ad22e707a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.087 s) : 0, 1086530
Total [baseline] (10.902 s) : 0, 10902344
Agent [candidate] (1.091 s) : 0, 1091035
Total [candidate] (10.903 s) : 0, 10902558
section appsec
Agent [baseline] (1.262 s) : 0, 1261577
Total [baseline] (10.973 s) : 0, 10973155
Agent [candidate] (1.264 s) : 0, 1264356
Total [candidate] (10.984 s) : 0, 10983856
section iast
Agent [baseline] (1.222 s) : 0, 1221840
Total [baseline] (11.238 s) : 0, 11237601
Agent [candidate] (1.232 s) : 0, 1232063
Total [candidate] (11.228 s) : 0, 11227992
section profiling
Agent [baseline] (1.205 s) : 0, 1205279
Total [baseline] (10.948 s) : 0, 10947558
Agent [candidate] (1.205 s) : 0, 1204631
Total [candidate] (10.914 s) : 0, 10913645

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.087 s	-
Agent	appsec	1.262 s	175.046 ms (16.1%)
Agent	iast	1.222 s	135.31 ms (12.5%)
Agent	profiling	1.205 s	118.749 ms (10.9%)
Total	tracing	10.902 s	-
Total	appsec	10.973 s	70.811 ms (0.6%)
Total	iast	11.238 s	335.256 ms (3.1%)
Total	profiling	10.948 s	45.214 ms (0.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.091 s	-
Agent	appsec	1.264 s	173.321 ms (15.9%)
Agent	iast	1.232 s	141.028 ms (12.9%)
Agent	profiling	1.205 s	113.595 ms (10.4%)
Total	tracing	10.903 s	-
Total	appsec	10.984 s	81.298 ms (0.7%)
Total	iast	11.228 s	325.434 ms (3.0%)
Total	profiling	10.914 s	11.087 ms (0.1%)

gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~33839e976b, baseline=1.57.0-SNAPSHOT~1ad22e707a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (654.279 ms) : 0, 654279
BytebuddyAgent [candidate] (654.513 ms) : 0, 654513
GlobalTracer [baseline] (281.963 ms) : 0, 281963
GlobalTracer [candidate] (284.431 ms) : 0, 284431
AppSec [baseline] (32.318 ms) : 0, 32318
AppSec [candidate] (32.842 ms) : 0, 32842
Debugger [baseline] (67.569 ms) : 0, 67569
Debugger [candidate] (68.995 ms) : 0, 68995
Remote Config [baseline] (641.302 µs) : 0, 641
Remote Config [candidate] (645.179 µs) : 0, 645
Telemetry [baseline] (9.113 ms) : 0, 9113
Telemetry [candidate] (9.096 ms) : 0, 9096
Flare Poller [baseline] (3.781 ms) : 0, 3781
Flare Poller [candidate] (3.753 ms) : 0, 3753
section appsec
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (687.327 ms) : 0, 687327
BytebuddyAgent [candidate] (689.466 ms) : 0, 689466
GlobalTracer [baseline] (258.235 ms) : 0, 258235
GlobalTracer [candidate] (258.495 ms) : 0, 258495
IAST [baseline] (24.572 ms) : 0, 24572
IAST [candidate] (24.569 ms) : 0, 24569
AppSec [baseline] (174.476 ms) : 0, 174476
AppSec [candidate] (174.826 ms) : 0, 174826
Debugger [baseline] (66.65 ms) : 0, 66650
Debugger [candidate] (66.615 ms) : 0, 66615
Remote Config [baseline] (712.875 µs) : 0, 713
Remote Config [candidate] (700.062 µs) : 0, 700
Telemetry [baseline] (9.072 ms) : 0, 9072
Telemetry [candidate] (9.08 ms) : 0, 9080
Flare Poller [baseline] (3.861 ms) : 0, 3861
Flare Poller [candidate] (3.942 ms) : 0, 3942
section iast
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (790.868 ms) : 0, 790868
BytebuddyAgent [candidate] (797.857 ms) : 0, 797857
GlobalTracer [baseline] (255.608 ms) : 0, 255608
GlobalTracer [candidate] (256.826 ms) : 0, 256826
IAST [baseline] (26.814 ms) : 0, 26814
IAST [candidate] (27.05 ms) : 0, 27050
AppSec [baseline] (34.989 ms) : 0, 34989
AppSec [candidate] (35.571 ms) : 0, 35571
Debugger [baseline] (64.645 ms) : 0, 64645
Debugger [candidate] (65.487 ms) : 0, 65487
Remote Config [baseline] (541.215 µs) : 0, 541
Remote Config [candidate] (564.979 µs) : 0, 565
Telemetry [baseline] (8.319 ms) : 0, 8319
Telemetry [candidate] (8.475 ms) : 0, 8475
Flare Poller [baseline] (3.44 ms) : 0, 3440
Flare Poller [candidate] (3.519 ms) : 0, 3519
section profiling
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.169 ms) : 0, 1169
BytebuddyAgent [baseline] (701.58 ms) : 0, 701580
BytebuddyAgent [candidate] (701.783 ms) : 0, 701783
GlobalTracer [baseline] (220.868 ms) : 0, 220868
GlobalTracer [candidate] (220.716 ms) : 0, 220716
AppSec [baseline] (32.299 ms) : 0, 32299
AppSec [candidate] (32.133 ms) : 0, 32133
Debugger [baseline] (68.327 ms) : 0, 68327
Debugger [candidate] (68.358 ms) : 0, 68358
Remote Config [baseline] (676.989 µs) : 0, 677
Remote Config [candidate] (639.002 µs) : 0, 639
Telemetry [baseline] (9.023 ms) : 0, 9023
Telemetry [candidate] (9.041 ms) : 0, 9041
Flare Poller [baseline] (3.772 ms) : 0, 3772
Flare Poller [candidate] (3.73 ms) : 0, 3730
ProfilingAgent [baseline] (97.514 ms) : 0, 97514
ProfilingAgent [candidate] (97.217 ms) : 0, 97217
Profiling [baseline] (98.111 ms) : 0, 98111
Profiling [candidate] (97.794 ms) : 0, 97794

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/update_config_docs
git_commit_date	1765554521	1765563969
git_commit_sha	1ad22e707a	33839e976b
release_version	1.57.0-SNAPSHOT~1ad22e707a	1.57.0-SNAPSHOT~33839e976b

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1765566253	1765566253
ci_job_id	1291829827	1291829827
ci_pipeline_id	86549194	86549194
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-22th69jk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-22th69jk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+94.667µs; +220.913µs] or [+3.506%; +8.183%]	unsure [+134.644µs; +602.692µs] or [+1.758%; +7.868%]	unstable [-200.243op/s; +60.931op/s] or [-14.897%; +4.533%]	2.858ms	8.029ms	1274.531op/s	2.700ms	7.660ms	1344.188op/s
scenario:load:insecure-bank:iast_FULL:high_load	unsure [-328.281µs; -92.060µs] or [-6.240%; -1.750%]	better [-984.643µs; -289.369µs] or [-7.783%; -2.287%]	unstable [-49.755op/s; +113.130op/s] or [-6.383%; +14.513%]	5.051ms	12.015ms	811.219op/s	5.261ms	12.652ms	779.531op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~33839e976b, baseline=1.57.0-SNAPSHOT~1ad22e707a
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.21 ms) : 18025, 18396
.   : milestone, 18210,
appsec (18.714 ms) : 18520, 18908
.   : milestone, 18714,
code_origins (17.728 ms) : 17553, 17902
.   : milestone, 17728,
iast (17.627 ms) : 17450, 17803
.   : milestone, 17627,
profiling (18.638 ms) : 18451, 18825
.   : milestone, 18638,
tracing (17.932 ms) : 17749, 18114
.   : milestone, 17932,
section candidate
no_agent (19.172 ms) : 18973, 19371
.   : milestone, 19172,
appsec (18.592 ms) : 18400, 18784
.   : milestone, 18592,
code_origins (17.625 ms) : 17450, 17800
.   : milestone, 17625,
iast (17.627 ms) : 17453, 17801
.   : milestone, 17627,
profiling (18.448 ms) : 18265, 18632
.   : milestone, 18448,
tracing (17.529 ms) : 17353, 17705
.   : milestone, 17529,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.21 ms [18.025 ms, 18.396 ms]	-
appsec	18.714 ms [18.52 ms, 18.908 ms]	503.929 µs (2.8%)
code_origins	17.728 ms [17.553 ms, 17.902 ms]	-482.705 µs (-2.7%)
iast	17.627 ms [17.45 ms, 17.803 ms]	-583.454 µs (-3.2%)
profiling	18.638 ms [18.451 ms, 18.825 ms]	427.749 µs (2.3%)
tracing	17.932 ms [17.749 ms, 18.114 ms]	-278.344 µs (-1.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.172 ms [18.973 ms, 19.371 ms]	-
appsec	18.592 ms [18.4 ms, 18.784 ms]	-580.335 µs (-3.0%)
code_origins	17.625 ms [17.45 ms, 17.8 ms]	-1.548 ms (-8.1%)
iast	17.627 ms [17.453 ms, 17.801 ms]	-1.545 ms (-8.1%)
profiling	18.448 ms [18.265 ms, 18.632 ms]	-724.0 µs (-3.8%)
tracing	17.529 ms [17.353 ms, 17.705 ms]	-1.643 ms (-8.6%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~33839e976b, baseline=1.57.0-SNAPSHOT~1ad22e707a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.203 ms) : 1191, 1215
.   : milestone, 1203,
iast (3.256 ms) : 3215, 3297
.   : milestone, 3256,
iast_FULL (5.934 ms) : 5874, 5994
.   : milestone, 5934,
iast_GLOBAL (3.407 ms) : 3364, 3450
.   : milestone, 3407,
profiling (2.097 ms) : 2078, 2116
.   : milestone, 2097,
tracing (1.818 ms) : 1803, 1833
.   : milestone, 1818,
section candidate
no_agent (1.212 ms) : 1200, 1223
.   : milestone, 1212,
iast (3.137 ms) : 3096, 3178
.   : milestone, 3137,
iast_FULL (5.698 ms) : 5641, 5756
.   : milestone, 5698,
iast_GLOBAL (3.598 ms) : 3549, 3648
.   : milestone, 3598,
profiling (2.168 ms) : 2146, 2189
.   : milestone, 2168,
tracing (1.823 ms) : 1808, 1838
.   : milestone, 1823,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.203 ms [1.191 ms, 1.215 ms]	-
iast	3.256 ms [3.215 ms, 3.297 ms]	2.053 ms (170.6%)
iast_FULL	5.934 ms [5.874 ms, 5.994 ms]	4.731 ms (393.2%)
iast_GLOBAL	3.407 ms [3.364 ms, 3.45 ms]	2.204 ms (183.2%)
profiling	2.097 ms [2.078 ms, 2.116 ms]	894.351 µs (74.3%)
tracing	1.818 ms [1.803 ms, 1.833 ms]	614.707 µs (51.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.212 ms [1.2 ms, 1.223 ms]	-
iast	3.137 ms [3.096 ms, 3.178 ms]	1.925 ms (158.9%)
iast_FULL	5.698 ms [5.641 ms, 5.756 ms]	4.487 ms (370.3%)
iast_GLOBAL	3.598 ms [3.549 ms, 3.648 ms]	2.387 ms (197.0%)
profiling	2.168 ms [2.146 ms, 2.189 ms]	956.014 µs (78.9%)
tracing	1.823 ms [1.808 ms, 1.838 ms]	611.419 µs (50.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/update_config_docs
git_commit_date	1765554521	1765563969
git_commit_sha	1ad22e707a	33839e976b
release_version	1.57.0-SNAPSHOT~1ad22e707a	1.57.0-SNAPSHOT~33839e976b

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1765566060	1765566060
ci_job_id	1291829828	1291829828
ci_pipeline_id	86549194	86549194
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-l8er8aeo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-l8er8aeo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~33839e976b, baseline=1.57.0-SNAPSHOT~1ad22e707a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.484 ms) : 1472, 1496
.   : milestone, 1484,
appsec (3.748 ms) : 3522, 3975
.   : milestone, 3748,
iast (2.232 ms) : 2167, 2297
.   : milestone, 2232,
iast_GLOBAL (2.271 ms) : 2205, 2337
.   : milestone, 2271,
profiling (2.492 ms) : 2330, 2654
.   : milestone, 2492,
tracing (2.064 ms) : 2013, 2116
.   : milestone, 2064,
section candidate
no_agent (1.484 ms) : 1472, 1495
.   : milestone, 1484,
appsec (3.755 ms) : 3534, 3976
.   : milestone, 3755,
iast (2.229 ms) : 2164, 2294
.   : milestone, 2229,
iast_GLOBAL (2.271 ms) : 2206, 2336
.   : milestone, 2271,
profiling (2.077 ms) : 2025, 2130
.   : milestone, 2077,
tracing (2.062 ms) : 2011, 2113
.   : milestone, 2062,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.484 ms [1.472 ms, 1.496 ms]	-
appsec	3.748 ms [3.522 ms, 3.975 ms]	2.264 ms (152.6%)
iast	2.232 ms [2.167 ms, 2.297 ms]	748.325 µs (50.4%)
iast_GLOBAL	2.271 ms [2.205 ms, 2.337 ms]	786.842 µs (53.0%)
profiling	2.492 ms [2.33 ms, 2.654 ms]	1.008 ms (67.9%)
tracing	2.064 ms [2.013 ms, 2.116 ms]	580.319 µs (39.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.484 ms [1.472 ms, 1.495 ms]	-
appsec	3.755 ms [3.534 ms, 3.976 ms]	2.272 ms (153.1%)
iast	2.229 ms [2.164 ms, 2.294 ms]	745.873 µs (50.3%)
iast_GLOBAL	2.271 ms [2.206 ms, 2.336 ms]	787.337 µs (53.1%)
profiling	2.077 ms [2.025 ms, 2.13 ms]	593.636 µs (40.0%)
tracing	2.062 ms [2.011 ms, 2.113 ms]	578.239 µs (39.0%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~33839e976b, baseline=1.57.0-SNAPSHOT~1ad22e707a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.306 s) : 15306000, 15306000
.   : milestone, 15306000,
appsec (14.681 s) : 14681000, 14681000
.   : milestone, 14681000,
iast (18.255 s) : 18255000, 18255000
.   : milestone, 18255000,
iast_GLOBAL (17.976 s) : 17976000, 17976000
.   : milestone, 17976000,
profiling (14.679 s) : 14679000, 14679000
.   : milestone, 14679000,
tracing (14.705 s) : 14705000, 14705000
.   : milestone, 14705000,
section candidate
no_agent (15.493 s) : 15493000, 15493000
.   : milestone, 15493000,
appsec (14.615 s) : 14615000, 14615000
.   : milestone, 14615000,
iast (18.423 s) : 18423000, 18423000
.   : milestone, 18423000,
iast_GLOBAL (17.688 s) : 17688000, 17688000
.   : milestone, 17688000,
profiling (15.095 s) : 15095000, 15095000
.   : milestone, 15095000,
tracing (14.638 s) : 14638000, 14638000
.   : milestone, 14638000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.306 s [15.306 s, 15.306 s]	-
appsec	14.681 s [14.681 s, 14.681 s]	-625.0 ms (-4.1%)
iast	18.255 s [18.255 s, 18.255 s]	2.949 s (19.3%)
iast_GLOBAL	17.976 s [17.976 s, 17.976 s]	2.67 s (17.4%)
profiling	14.679 s [14.679 s, 14.679 s]	-627.0 ms (-4.1%)
tracing	14.705 s [14.705 s, 14.705 s]	-601.0 ms (-3.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.493 s [15.493 s, 15.493 s]	-
appsec	14.615 s [14.615 s, 14.615 s]	-878.0 ms (-5.7%)
iast	18.423 s [18.423 s, 18.423 s]	2.93 s (18.9%)
iast_GLOBAL	17.688 s [17.688 s, 17.688 s]	2.195 s (14.2%)
profiling	15.095 s [15.095 s, 15.095 s]	-398.0 ms (-2.6%)
tracing	14.638 s [14.638 s, 14.638 s]	-855.0 ms (-5.5%)

Dec 12 '25 19:12 pr-commenter[bot]