Enable Spark Plan metadata parsing by default

Open charlesmyu opened this issue 2 months ago • 1 comments

What Does This Do

Enables Spark Plan metadata parsing for all users with Spark instrumentation enabled.

Motivation

This has been tested internally for ~2-3 weeks and seems to be stable. Ship this to all users!

Additional Notes

N/A

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: DJM-974

Dec 11 '25 15:12 charlesmyu

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	charles.yu/djm-974/parse-plan-by-default
git_commit_date	1766360949	1766379991
git_commit_sha	88bafa2ade	6adfc2c6d6
release_version	1.58.0-SNAPSHOT~88bafa2ade	1.57.0-SNAPSHOT~6adfc2c6d6

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1766381851	1766381851
ci_job_id	1312527542	1312527542
ci_pipeline_id	87991020	87991020
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-aaf24hmi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-aaf24hmi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~6adfc2c6d6, baseline=1.58.0-SNAPSHOT~88bafa2ade

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.084 s) : 0, 1083591
Total [baseline] (10.804 s) : 0, 10804422
Agent [candidate] (1.086 s) : 0, 1086220
Total [candidate] (10.825 s) : 0, 10824827
section appsec
Agent [baseline] (1.266 s) : 0, 1265543
Total [baseline] (10.903 s) : 0, 10902583
Agent [candidate] (1.269 s) : 0, 1269487
Total [candidate] (10.908 s) : 0, 10907644
section iast
Agent [baseline] (1.224 s) : 0, 1224391
Total [baseline] (11.1 s) : 0, 11099729
Agent [candidate] (1.226 s) : 0, 1225656
Total [candidate] (11.149 s) : 0, 11149094
section profiling
Agent [baseline] (1.206 s) : 0, 1205958
Total [baseline] (10.953 s) : 0, 10953499
Agent [candidate] (1.205 s) : 0, 1204759
Total [candidate] (10.952 s) : 0, 10951903

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.084 s	-
Agent	appsec	1.266 s	181.952 ms (16.8%)
Agent	iast	1.224 s	140.8 ms (13.0%)
Agent	profiling	1.206 s	122.367 ms (11.3%)
Total	tracing	10.804 s	-
Total	appsec	10.903 s	98.161 ms (0.9%)
Total	iast	11.1 s	295.307 ms (2.7%)
Total	profiling	10.953 s	149.077 ms (1.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.086 s	-
Agent	appsec	1.269 s	183.267 ms (16.9%)
Agent	iast	1.226 s	139.436 ms (12.8%)
Agent	profiling	1.205 s	118.539 ms (10.9%)
Total	tracing	10.825 s	-
Total	appsec	10.908 s	82.816 ms (0.8%)
Total	iast	11.149 s	324.266 ms (3.0%)
Total	profiling	10.952 s	127.075 ms (1.2%)

gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~6adfc2c6d6, baseline=1.58.0-SNAPSHOT~88bafa2ade

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (650.445 ms) : 0, 650445
BytebuddyAgent [candidate] (652.236 ms) : 0, 652236
GlobalTracer [baseline] (282.185 ms) : 0, 282185
GlobalTracer [candidate] (282.743 ms) : 0, 282743
AppSec [baseline] (32.597 ms) : 0, 32597
AppSec [candidate] (32.752 ms) : 0, 32752
Debugger [baseline] (68.342 ms) : 0, 68342
Debugger [candidate] (68.402 ms) : 0, 68402
Remote Config [baseline] (642.848 µs) : 0, 643
Remote Config [candidate] (640.313 µs) : 0, 640
Telemetry [baseline] (9.014 ms) : 0, 9014
Telemetry [candidate] (8.993 ms) : 0, 8993
Flare Poller [baseline] (3.764 ms) : 0, 3764
Flare Poller [candidate] (3.736 ms) : 0, 3736
section appsec
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (691.862 ms) : 0, 691862
BytebuddyAgent [candidate] (694.547 ms) : 0, 694547
GlobalTracer [baseline] (257.619 ms) : 0, 257619
GlobalTracer [candidate] (258.574 ms) : 0, 258574
AppSec [baseline] (174.855 ms) : 0, 174855
AppSec [candidate] (174.453 ms) : 0, 174453
Debugger [baseline] (66.0 ms) : 0, 66000
Debugger [candidate] (66.734 ms) : 0, 66734
Remote Config [baseline] (767.153 µs) : 0, 767
Remote Config [candidate] (716.186 µs) : 0, 716
Telemetry [baseline] (9.381 ms) : 0, 9381
Telemetry [candidate] (9.294 ms) : 0, 9294
Flare Poller [baseline] (3.657 ms) : 0, 3657
Flare Poller [candidate] (3.684 ms) : 0, 3684
IAST [baseline] (24.776 ms) : 0, 24776
IAST [candidate] (24.792 ms) : 0, 24792
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (792.682 ms) : 0, 792682
BytebuddyAgent [candidate] (793.22 ms) : 0, 793220
GlobalTracer [baseline] (255.413 ms) : 0, 255413
GlobalTracer [candidate] (255.956 ms) : 0, 255956
AppSec [baseline] (33.707 ms) : 0, 33707
AppSec [candidate] (33.579 ms) : 0, 33579
Debugger [baseline] (66.329 ms) : 0, 66329
Debugger [candidate] (66.632 ms) : 0, 66632
Remote Config [baseline] (584.964 µs) : 0, 585
Remote Config [candidate] (604.803 µs) : 0, 605
Telemetry [baseline] (8.56 ms) : 0, 8560
Telemetry [candidate] (8.501 ms) : 0, 8501
Flare Poller [baseline] (3.49 ms) : 0, 3490
Flare Poller [candidate] (3.479 ms) : 0, 3479
IAST [baseline] (26.986 ms) : 0, 26986
IAST [candidate] (26.997 ms) : 0, 26997
section profiling
crashtracking [baseline] (1.22 ms) : 0, 1220
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (704.658 ms) : 0, 704658
BytebuddyAgent [candidate] (703.96 ms) : 0, 703960
GlobalTracer [baseline] (220.196 ms) : 0, 220196
GlobalTracer [candidate] (220.104 ms) : 0, 220104
AppSec [baseline] (32.227 ms) : 0, 32227
AppSec [candidate] (32.021 ms) : 0, 32021
Debugger [baseline] (68.056 ms) : 0, 68056
Debugger [candidate] (67.749 ms) : 0, 67749
Remote Config [baseline] (647.368 µs) : 0, 647
Remote Config [candidate] (613.719 µs) : 0, 614
Telemetry [baseline] (8.777 ms) : 0, 8777
Telemetry [candidate] (8.653 ms) : 0, 8653
Flare Poller [baseline] (3.694 ms) : 0, 3694
Flare Poller [candidate] (3.64 ms) : 0, 3640
ProfilingAgent [baseline] (96.686 ms) : 0, 96686
ProfilingAgent [candidate] (97.022 ms) : 0, 97022
Profiling [baseline] (97.268 ms) : 0, 97268
Profiling [candidate] (97.587 ms) : 0, 97587

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~6adfc2c6d6, baseline=1.58.0-SNAPSHOT~88bafa2ade

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.091 s) : 0, 1091049
Total [baseline] (8.793 s) : 0, 8792687
Agent [candidate] (1.1 s) : 0, 1099812
Total [candidate] (8.803 s) : 0, 8803023
section iast
Agent [baseline] (1.226 s) : 0, 1226165
Total [baseline] (9.334 s) : 0, 9334108
Agent [candidate] (1.223 s) : 0, 1223360
Total [candidate] (9.316 s) : 0, 9315524

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.091 s	-
Agent	iast	1.226 s	135.117 ms (12.4%)
Total	tracing	8.793 s	-
Total	iast	9.334 s	541.42 ms (6.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.1 s	-
Agent	iast	1.223 s	123.548 ms (11.2%)
Total	tracing	8.803 s	-
Total	iast	9.316 s	512.501 ms (5.8%)

gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~6adfc2c6d6, baseline=1.58.0-SNAPSHOT~88bafa2ade

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (656.333 ms) : 0, 656333
BytebuddyAgent [candidate] (662.045 ms) : 0, 662045
GlobalTracer [baseline] (283.747 ms) : 0, 283747
GlobalTracer [candidate] (286.211 ms) : 0, 286211
AppSec [baseline] (32.84 ms) : 0, 32840
AppSec [candidate] (33.059 ms) : 0, 33059
Debugger [baseline] (67.759 ms) : 0, 67759
Debugger [candidate] (67.84 ms) : 0, 67840
Remote Config [baseline] (611.964 µs) : 0, 612
Remote Config [candidate] (642.987 µs) : 0, 643
Telemetry [baseline] (9.103 ms) : 0, 9103
Telemetry [candidate] (9.12 ms) : 0, 9120
Flare Poller [baseline] (3.733 ms) : 0, 3733
Flare Poller [candidate] (3.81 ms) : 0, 3810
section iast
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.208 ms) : 0, 1208
BytebuddyAgent [baseline] (793.396 ms) : 0, 793396
BytebuddyAgent [candidate] (791.596 ms) : 0, 791596
GlobalTracer [baseline] (255.525 ms) : 0, 255525
GlobalTracer [candidate] (255.393 ms) : 0, 255393
AppSec [baseline] (34.76 ms) : 0, 34760
AppSec [candidate] (35.062 ms) : 0, 35062
Debugger [baseline] (65.854 ms) : 0, 65854
Debugger [candidate] (64.795 ms) : 0, 64795
Remote Config [baseline] (610.885 µs) : 0, 611
Remote Config [candidate] (576.595 µs) : 0, 577
Telemetry [baseline] (8.671 ms) : 0, 8671
Telemetry [candidate] (8.584 ms) : 0, 8584
Flare Poller [baseline] (3.526 ms) : 0, 3526
Flare Poller [candidate] (3.449 ms) : 0, 3449
IAST [baseline] (27.088 ms) : 0, 27088
IAST [candidate] (27.18 ms) : 0, 27180

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	charles.yu/djm-974/parse-plan-by-default
git_commit_date	1766360949	1766379991
git_commit_sha	88bafa2ade	6adfc2c6d6
release_version	1.58.0-SNAPSHOT~88bafa2ade	1.57.0-SNAPSHOT~6adfc2c6d6

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1766382497	1766382497
ci_job_id	1312527543	1312527543
ci_pipeline_id	87991020	87991020
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-ats60o1c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-ats60o1c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 15 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	better [-306.643µs; -212.491µs] or [-10.502%; -7.277%]	better [-896.311µs; -451.827µs] or [-10.986%; -5.538%]	unstable [-32.904op/s; +243.091op/s] or [-2.630%; +19.429%]	2.660ms	7.485ms	1356.281op/s	2.920ms	8.159ms	1251.188op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~6adfc2c6d6, baseline=1.58.0-SNAPSHOT~88bafa2ade
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.971 ms) : 18779, 19164
.   : milestone, 18971,
appsec (18.664 ms) : 18475, 18854
.   : milestone, 18664,
code_origins (17.937 ms) : 17757, 18118
.   : milestone, 17937,
iast (17.838 ms) : 17657, 18020
.   : milestone, 17838,
profiling (18.608 ms) : 18423, 18794
.   : milestone, 18608,
tracing (17.876 ms) : 17690, 18062
.   : milestone, 17876,
section candidate
no_agent (19.179 ms) : 18979, 19379
.   : milestone, 19179,
appsec (18.497 ms) : 18312, 18683
.   : milestone, 18497,
code_origins (17.832 ms) : 17653, 18011
.   : milestone, 17832,
iast (18.152 ms) : 17970, 18335
.   : milestone, 18152,
profiling (18.606 ms) : 18419, 18794
.   : milestone, 18606,
tracing (17.641 ms) : 17467, 17816
.   : milestone, 17641,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.971 ms [18.779 ms, 19.164 ms]	-
appsec	18.664 ms [18.475 ms, 18.854 ms]	-307.074 µs (-1.6%)
code_origins	17.937 ms [17.757 ms, 18.118 ms]	-1.034 ms (-5.4%)
iast	17.838 ms [17.657 ms, 18.02 ms]	-1.133 ms (-6.0%)
profiling	18.608 ms [18.423 ms, 18.794 ms]	-362.805 µs (-1.9%)
tracing	17.876 ms [17.69 ms, 18.062 ms]	-1.095 ms (-5.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.179 ms [18.979 ms, 19.379 ms]	-
appsec	18.497 ms [18.312 ms, 18.683 ms]	-681.687 µs (-3.6%)
code_origins	17.832 ms [17.653 ms, 18.011 ms]	-1.347 ms (-7.0%)
iast	18.152 ms [17.97 ms, 18.335 ms]	-1.027 ms (-5.4%)
profiling	18.606 ms [18.419 ms, 18.794 ms]	-572.701 µs (-3.0%)
tracing	17.641 ms [17.467 ms, 17.816 ms]	-1.538 ms (-8.0%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~6adfc2c6d6, baseline=1.58.0-SNAPSHOT~88bafa2ade
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.201 ms) : 1189, 1212
.   : milestone, 1201,
iast (3.129 ms) : 3091, 3168
.   : milestone, 3129,
iast_FULL (5.794 ms) : 5737, 5851
.   : milestone, 5794,
iast_GLOBAL (3.667 ms) : 3612, 3721
.   : milestone, 3667,
profiling (1.912 ms) : 1896, 1928
.   : milestone, 1912,
tracing (1.799 ms) : 1784, 1814
.   : milestone, 1799,
section candidate
no_agent (1.193 ms) : 1181, 1205
.   : milestone, 1193,
iast (3.254 ms) : 3218, 3291
.   : milestone, 3254,
iast_FULL (5.863 ms) : 5804, 5922
.   : milestone, 5863,
iast_GLOBAL (3.377 ms) : 3328, 3426
.   : milestone, 3377,
profiling (1.985 ms) : 1969, 2002
.   : milestone, 1985,
tracing (1.839 ms) : 1824, 1854
.   : milestone, 1839,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.201 ms [1.189 ms, 1.212 ms]	-
iast	3.129 ms [3.091 ms, 3.168 ms]	1.929 ms (160.7%)
iast_FULL	5.794 ms [5.737 ms, 5.851 ms]	4.593 ms (382.6%)
iast_GLOBAL	3.667 ms [3.612 ms, 3.721 ms]	2.466 ms (205.4%)
profiling	1.912 ms [1.896 ms, 1.928 ms]	711.551 µs (59.3%)
tracing	1.799 ms [1.784 ms, 1.814 ms]	598.605 µs (49.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.193 ms [1.181 ms, 1.205 ms]	-
iast	3.254 ms [3.218 ms, 3.291 ms]	2.061 ms (172.7%)
iast_FULL	5.863 ms [5.804 ms, 5.922 ms]	4.67 ms (391.4%)
iast_GLOBAL	3.377 ms [3.328 ms, 3.426 ms]	2.184 ms (183.0%)
profiling	1.985 ms [1.969 ms, 2.002 ms]	791.99 µs (66.4%)
tracing	1.839 ms [1.824 ms, 1.854 ms]	645.749 µs (54.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	charles.yu/djm-974/parse-plan-by-default
git_commit_date	1766360949	1766379991
git_commit_sha	88bafa2ade	6adfc2c6d6
release_version	1.58.0-SNAPSHOT~88bafa2ade	1.57.0-SNAPSHOT~6adfc2c6d6

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1766382250	1766382250
ci_job_id	1312527544	1312527544
ci_pipeline_id	87991020	87991020
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-fa2wws60 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-fa2wws60 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~6adfc2c6d6, baseline=1.58.0-SNAPSHOT~88bafa2ade
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.626 s) : 15626000, 15626000
.   : milestone, 15626000,
appsec (14.869 s) : 14869000, 14869000
.   : milestone, 14869000,
iast (18.601 s) : 18601000, 18601000
.   : milestone, 18601000,
iast_GLOBAL (18.024 s) : 18024000, 18024000
.   : milestone, 18024000,
profiling (14.566 s) : 14566000, 14566000
.   : milestone, 14566000,
tracing (14.927 s) : 14927000, 14927000
.   : milestone, 14927000,
section candidate
no_agent (15.42 s) : 15420000, 15420000
.   : milestone, 15420000,
appsec (14.38 s) : 14380000, 14380000
.   : milestone, 14380000,
iast (18.269 s) : 18269000, 18269000
.   : milestone, 18269000,
iast_GLOBAL (17.898 s) : 17898000, 17898000
.   : milestone, 17898000,
profiling (15.595 s) : 15595000, 15595000
.   : milestone, 15595000,
tracing (14.68 s) : 14680000, 14680000
.   : milestone, 14680000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.626 s [15.626 s, 15.626 s]	-
appsec	14.869 s [14.869 s, 14.869 s]	-757.0 ms (-4.8%)
iast	18.601 s [18.601 s, 18.601 s]	2.975 s (19.0%)
iast_GLOBAL	18.024 s [18.024 s, 18.024 s]	2.398 s (15.3%)
profiling	14.566 s [14.566 s, 14.566 s]	-1.06 s (-6.8%)
tracing	14.927 s [14.927 s, 14.927 s]	-699.0 ms (-4.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.42 s [15.42 s, 15.42 s]	-
appsec	14.38 s [14.38 s, 14.38 s]	-1.04 s (-6.7%)
iast	18.269 s [18.269 s, 18.269 s]	2.849 s (18.5%)
iast_GLOBAL	17.898 s [17.898 s, 17.898 s]	2.478 s (16.1%)
profiling	15.595 s [15.595 s, 15.595 s]	175.0 ms (1.1%)
tracing	14.68 s [14.68 s, 14.68 s]	-740.0 ms (-4.8%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~6adfc2c6d6, baseline=1.58.0-SNAPSHOT~88bafa2ade
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.701 ms) : 3480, 3922
.   : milestone, 3701,
iast (2.213 ms) : 2148, 2278
.   : milestone, 2213,
iast_GLOBAL (2.257 ms) : 2192, 2322
.   : milestone, 2257,
profiling (2.088 ms) : 2034, 2143
.   : milestone, 2088,
tracing (2.049 ms) : 1997, 2101
.   : milestone, 2049,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.726 ms) : 3506, 3945
.   : milestone, 3726,
iast (2.211 ms) : 2147, 2275
.   : milestone, 2211,
iast_GLOBAL (2.261 ms) : 2195, 2326
.   : milestone, 2261,
profiling (2.05 ms) : 1998, 2103
.   : milestone, 2050,
tracing (2.046 ms) : 1995, 2097
.   : milestone, 2046,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.46 ms, 1.483 ms]	-
appsec	3.701 ms [3.48 ms, 3.922 ms]	2.229 ms (151.5%)
iast	2.213 ms [2.148 ms, 2.278 ms]	741.746 µs (50.4%)
iast_GLOBAL	2.257 ms [2.192 ms, 2.322 ms]	785.605 µs (53.4%)
profiling	2.088 ms [2.034 ms, 2.143 ms]	616.578 µs (41.9%)
tracing	2.049 ms [1.997 ms, 2.101 ms]	577.501 µs (39.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.485 ms]	-
appsec	3.726 ms [3.506 ms, 3.945 ms]	2.252 ms (152.8%)
iast	2.211 ms [2.147 ms, 2.275 ms]	737.2 µs (50.0%)
iast_GLOBAL	2.261 ms [2.195 ms, 2.326 ms]	787.099 µs (53.4%)
profiling	2.05 ms [1.998 ms, 2.103 ms]	576.512 µs (39.1%)
tracing	2.046 ms [1.995 ms, 2.097 ms]	572.034 µs (38.8%)

Dec 11 '25 16:12 pr-commenter[bot]