What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

Sep 19 '25 09:09 igoragoli

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 60.14% (+0.29%)
View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: efa6975 | Docs | Was this helpful? Give us feedback!}

Sep 19 '25 10:09 datadog-official[bot]

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	augusto/benchmark-load-experiments
git_commit_date	1760603875	1760606690
git_commit_sha	316ea27225	efa6975220
release_version	1.55.0-SNAPSHOT~316ea27225	1.54.0-SNAPSHOT~efa6975220

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1760608699	1760608699
ci_job_id	1182186297	1182186297
ci_pipeline_id	79465786	79465786
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-daxiuvg4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-daxiuvg4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 6 performance improvements and 20 performance regressions! Performance is the same for 26 metrics, 7 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start	worse [+36.634ms; +47.102ms] or [+3.191%; +4.103%]	1.190s	1.148s
scenario:startup:insecure-bank:iast:crashtracking	better [-64.766µs; -40.252µs] or [-4.323%; -2.687%]	1.446ms	1.498ms
scenario:startup:insecure-bank:iast:BytebuddyAgent	worse [+35.205ms; +42.786ms] or [+4.328%; +5.261%]	852.339ms	813.343ms
scenario:startup:insecure-bank:iast:GlobalTracer	worse [+12.121ms; +17.436ms] or [+5.262%; +7.569%]	245.158ms	230.379ms
scenario:startup:insecure-bank:iast:AppSec	better [-11.368ms; -7.970ms] or [-32.484%; -22.774%]	25.327ms	34.995ms
scenario:startup:insecure-bank:iast:Telemetry	better [-774.629µs; -356.584µs] or [-8.846%; -4.072%]	8.192ms	8.757ms
scenario:startup:insecure-bank:tracing:Agent.start	worse [+33.830ms; +77.750ms] or [+3.318%; +7.624%]	1.076s	1.020s
scenario:startup:insecure-bank:tracing:BytebuddyAgent	worse [+29.176ms; +62.048ms] or [+4.185%; +8.901%]	742.682ms	697.070ms
scenario:startup:insecure-bank:tracing:GlobalTracer	worse [+9.605ms; +18.799ms] or [+3.984%; +7.797%]	255.306ms	241.104ms
scenario:startup:insecure-bank:tracing:Telemetry	worse [+6.971ms; +7.794ms] or [+75.919%; +84.880%]	16.564ms	9.182ms
scenario:startup:petclinic:appsec:Agent.start	worse [+36.849ms; +48.404ms] or [+3.085%; +4.053%]	1.237s	1.194s
scenario:startup:petclinic:appsec:BytebuddyAgent	worse [+35.818ms; +42.721ms] or [+4.988%; +5.950%]	757.296ms	718.026ms
scenario:startup:petclinic:appsec:GlobalTracer	worse [+9.929ms; +13.073ms] or [+4.230%; +5.569%]	246.243ms	234.743ms
scenario:startup:petclinic:appsec:IAST	better [-1062.806µs; -570.184µs] or [-4.299%; -2.306%]	23.907ms	24.724ms
scenario:startup:petclinic:iast:Agent.start	worse [+37.057ms; +48.800ms] or [+3.227%; +4.250%]	1.191s	1.148s
scenario:startup:petclinic:iast:BytebuddyAgent	worse [+35.083ms; +43.434ms] or [+4.313%; +5.340%]	852.625ms	813.366ms
scenario:startup:petclinic:iast:GlobalTracer	worse [+13.272ms; +18.253ms] or [+5.748%; +7.905%]	246.658ms	230.896ms
scenario:startup:petclinic:iast:Telemetry	better [-604.147µs; -177.994µs] or [-6.983%; -2.057%]	8.260ms	8.651ms
scenario:startup:petclinic:profiling:Agent.start	worse [+46.011ms; +61.289ms] or [+3.973%; +5.292%]	1.212s	1.158s
scenario:startup:petclinic:profiling:BytebuddyAgent	worse [+40.042ms; +46.973ms] or [+5.565%; +6.529%]	763.002ms	719.494ms
scenario:startup:petclinic:profiling:GlobalTracer	worse [+14.680ms; +17.733ms] or [+6.766%; +8.173%]	233.172ms	216.966ms
scenario:startup:petclinic:tracing:Agent.start	worse [+25.152ms; +51.583ms] or [+2.461%; +5.048%]	1.060s	1.022s
scenario:startup:petclinic:tracing:BytebuddyAgent	worse [+24.483ms; +44.318ms] or [+3.511%; +6.356%]	731.692ms	697.292ms
scenario:startup:petclinic:tracing:GlobalTracer	worse [+6.692ms; +12.339ms] or [+2.760%; +5.088%]	252.014ms	242.499ms
scenario:startup:petclinic:tracing:AppSec	better [-2.163ms; -1.564ms] or [-6.663%; -4.816%]	30.608ms	32.472ms
scenario:startup:petclinic:tracing:Telemetry	worse [+6.978ms; +7.504ms] or [+76.565%; +82.331%]	16.355ms	9.114ms

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~efa6975220, baseline=1.55.0-SNAPSHOT~316ea27225

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1019741
Total [baseline] (8.692 s) : 0, 8692306
Agent [candidate] (1.076 s) : 0, 1075531
Total [candidate] (8.705 s) : 0, 8704681
section iast
Agent [baseline] (1.148 s) : 0, 1147892
Total [baseline] (9.266 s) : 0, 9265649
Agent [candidate] (1.19 s) : 0, 1189760
Total [candidate] (9.318 s) : 0, 9317605

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.02 s	-
Agent	iast	1.148 s	128.152 ms (12.6%)
Total	tracing	8.692 s	-
Total	iast	9.266 s	573.343 ms (6.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.076 s	-
Agent	iast	1.19 s	114.229 ms (10.6%)
Total	tracing	8.705 s	-
Total	iast	9.318 s	612.925 ms (7.0%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~efa6975220, baseline=1.55.0-SNAPSHOT~316ea27225

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.489 ms) : 0, 1489
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (697.07 ms) : 0, 697070
BytebuddyAgent [candidate] (742.682 ms) : 0, 742682
GlobalTracer [baseline] (241.104 ms) : 0, 241104
GlobalTracer [candidate] (255.306 ms) : 0, 255306
AppSec [baseline] (32.395 ms) : 0, 32395
AppSec [candidate] (31.088 ms) : 0, 31088
Debugger [baseline] (6.424 ms) : 0, 6424
Debugger [candidate] (6.478 ms) : 0, 6478
Remote Config [baseline] (705.544 µs) : 0, 706
Remote Config [candidate] (703.821 µs) : 0, 704
Telemetry [baseline] (9.182 ms) : 0, 9182
Telemetry [candidate] (16.564 ms) : 0, 16564
Flare Poller [baseline] (10.152 ms) : 0, 10152
section iast
crashtracking [baseline] (1.498 ms) : 0, 1498
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (813.343 ms) : 0, 813343
BytebuddyAgent [candidate] (852.339 ms) : 0, 852339
GlobalTracer [baseline] (230.379 ms) : 0, 230379
GlobalTracer [candidate] (245.158 ms) : 0, 245158
IAST [baseline] (26.4 ms) : 0, 26400
IAST [candidate] (29.685 ms) : 0, 29685
AppSec [baseline] (34.995 ms) : 0, 34995
AppSec [candidate] (25.327 ms) : 0, 25327
Debugger [baseline] (6.192 ms) : 0, 6192
Debugger [candidate] (6.094 ms) : 0, 6094
Remote Config [baseline] (611.227 µs) : 0, 611
Remote Config [candidate] (595.316 µs) : 0, 595
Telemetry [baseline] (8.757 ms) : 0, 8757
Telemetry [candidate] (8.192 ms) : 0, 8192
Flare Poller [baseline] (4.216 ms) : 0, 4216

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~efa6975220, baseline=1.55.0-SNAPSHOT~316ea27225

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.022 s) : 0, 1021922
Total [baseline] (10.69 s) : 0, 10690112
Agent [candidate] (1.06 s) : 0, 1060289
Total [candidate] (10.733 s) : 0, 10732878
section appsec
Agent [baseline] (1.194 s) : 0, 1194394
Total [baseline] (11.08 s) : 0, 11080339
Agent [candidate] (1.237 s) : 0, 1237020
Total [candidate] (11.014 s) : 0, 11014057
section iast
Agent [baseline] (1.148 s) : 0, 1148298
Total [baseline] (10.988 s) : 0, 10987557
Agent [candidate] (1.191 s) : 0, 1191227
Total [candidate] (11.056 s) : 0, 11055841
section profiling
Agent [baseline] (1.158 s) : 0, 1158244
Total [baseline] (11.051 s) : 0, 11051281
Agent [candidate] (1.212 s) : 0, 1211894
Total [candidate] (11.025 s) : 0, 11025003

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.022 s	-
Agent	appsec	1.194 s	172.472 ms (16.9%)
Agent	iast	1.148 s	126.376 ms (12.4%)
Agent	profiling	1.158 s	136.322 ms (13.3%)
Total	tracing	10.69 s	-
Total	appsec	11.08 s	390.227 ms (3.7%)
Total	iast	10.988 s	297.445 ms (2.8%)
Total	profiling	11.051 s	361.168 ms (3.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.06 s	-
Agent	appsec	1.237 s	176.731 ms (16.7%)
Agent	iast	1.191 s	130.937 ms (12.3%)
Agent	profiling	1.212 s	151.605 ms (14.3%)
Total	tracing	10.733 s	-
Total	appsec	11.014 s	281.179 ms (2.6%)
Total	iast	11.056 s	322.962 ms (3.0%)
Total	profiling	11.025 s	292.125 ms (2.7%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~efa6975220, baseline=1.55.0-SNAPSHOT~316ea27225

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.45 ms) : 0, 1450
BytebuddyAgent [baseline] (697.292 ms) : 0, 697292
BytebuddyAgent [candidate] (731.692 ms) : 0, 731692
GlobalTracer [baseline] (242.499 ms) : 0, 242499
GlobalTracer [candidate] (252.014 ms) : 0, 252014
AppSec [baseline] (32.472 ms) : 0, 32472
AppSec [candidate] (30.608 ms) : 0, 30608
Debugger [baseline] (6.419 ms) : 0, 6419
Debugger [candidate] (6.375 ms) : 0, 6375
Remote Config [baseline] (696.175 µs) : 0, 696
Remote Config [candidate] (677.796 µs) : 0, 678
Telemetry [baseline] (9.114 ms) : 0, 9114
Telemetry [candidate] (16.355 ms) : 0, 16355
Flare Poller [baseline] (10.793 ms) : 0, 10793
section appsec
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (718.026 ms) : 0, 718026
BytebuddyAgent [candidate] (757.296 ms) : 0, 757296
GlobalTracer [baseline] (234.743 ms) : 0, 234743
GlobalTracer [candidate] (246.243 ms) : 0, 246243
IAST [baseline] (24.724 ms) : 0, 24724
IAST [candidate] (23.907 ms) : 0, 23907
AppSec [baseline] (175.254 ms) : 0, 175254
AppSec [candidate] (171.892 ms) : 0, 171892
Debugger [baseline] (6.073 ms) : 0, 6073
Debugger [candidate] (5.965 ms) : 0, 5965
Remote Config [baseline] (624.495 µs) : 0, 624
Remote Config [candidate] (613.822 µs) : 0, 614
Telemetry [baseline] (8.464 ms) : 0, 8464
Telemetry [candidate] (8.398 ms) : 0, 8398
Flare Poller [baseline] (3.952 ms) : 0, 3952
section iast
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (813.366 ms) : 0, 813366
BytebuddyAgent [candidate] (852.625 ms) : 0, 852625
GlobalTracer [baseline] (230.896 ms) : 0, 230896
GlobalTracer [candidate] (246.658 ms) : 0, 246658
IAST [baseline] (26.381 ms) : 0, 26381
IAST [candidate] (27.13 ms) : 0, 27130
AppSec [baseline] (35.054 ms) : 0, 35054
AppSec [candidate] (27.308 ms) : 0, 27308
Debugger [baseline] (6.118 ms) : 0, 6118
Debugger [candidate] (6.04 ms) : 0, 6040
Remote Config [baseline] (604.342 µs) : 0, 604
Remote Config [candidate] (603.517 µs) : 0, 604
Telemetry [baseline] (8.651 ms) : 0, 8651
Telemetry [candidate] (8.26 ms) : 0, 8260
Flare Poller [baseline] (4.275 ms) : 0, 4275
section profiling
crashtracking [baseline] (1.431 ms) : 0, 1431
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (719.494 ms) : 0, 719494
BytebuddyAgent [candidate] (763.002 ms) : 0, 763002
GlobalTracer [baseline] (216.966 ms) : 0, 216966
GlobalTracer [candidate] (233.172 ms) : 0, 233172
AppSec [baseline] (32.095 ms) : 0, 32095
AppSec [candidate] (31.523 ms) : 0, 31523
Debugger [baseline] (8.107 ms) : 0, 8107
Debugger [candidate] (7.441 ms) : 0, 7441
Remote Config [baseline] (772.788 µs) : 0, 773
Remote Config [candidate] (706.629 µs) : 0, 707
Telemetry [baseline] (14.635 ms) : 0, 14635
Telemetry [candidate] (14.914 ms) : 0, 14914
Flare Poller [baseline] (4.047 ms) : 0, 4047
ProfilingAgent [baseline] (108.077 ms) : 0, 108077
ProfilingAgent [candidate] (108.449 ms) : 0, 108449
Profiling [baseline] (108.791 ms) : 0, 108791
Profiling [candidate] (109.117 ms) : 0, 109117

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	augusto/benchmark-load-experiments
git_commit_date	1760603875	1760606690
git_commit_sha	316ea27225	efa6975220
release_version	1.55.0-SNAPSHOT~316ea27225	1.54.0-SNAPSHOT~efa6975220

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1760608307	1760608307
ci_job_id	1182186298	1182186298
ci_pipeline_id	79465786	79465786
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-v5057ayp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-v5057ayp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 9 performance improvements and 4 performance regressions! Performance is the same for 5 metrics, 6 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast:high_load	better [-180.130µs; -115.530µs] or [-4.225%; -2.710%]	unstable [-33.681op/s; +114.176op/s] or [-2.959%; +10.030%]	4.116ms	1178.644op/s	4.263ms	1138.396op/s
scenario:load:insecure-bank:tracing:high_load	better [-178.421µs; -140.504µs] or [-6.309%; -4.968%]	unstable [-52.503op/s; +250.324op/s] or [-3.088%; +14.721%]	2.668ms	1799.376op/s	2.828ms	1700.465op/s
scenario:load:insecure-bank:profiling:high_load	better [-422.109µs; -380.725µs] or [-12.883%; -11.620%]	unstable [+74.840op/s; +326.032op/s] or [+5.081%; +22.134%]	2.875ms	1673.436op/s	3.276ms	1473.000op/s
scenario:load:petclinic:appsec:high_load	worse [+1.865ms; +2.171ms] or [+9.876%; +11.496%]	worse [-33.708op/s; -16.193op/s] or [-13.003%; -6.247%]	20.905ms	234.279op/s	18.887ms	259.230op/s
scenario:load:petclinic:profiling:high_load	better [-1.981ms; -1.687ms] or [-9.770%; -8.320%]	better [+14.407op/s; +33.364op/s] or [+5.965%; +13.813%]	18.441ms	265.426op/s	20.275ms	241.541op/s
scenario:load:petclinic:no_agent:high_load	worse [+1.791ms; +2.060ms] or [+10.481%; +12.053%]	worse [-39.642op/s; -18.063op/s] or [-13.846%; -6.309%]	19.017ms	257.443op/s	17.091ms	286.295op/s
scenario:load:petclinic:code_origins:high_load	better [-1.621ms; -1.330ms] or [-8.139%; -6.678%]	better [+10.172op/s; +28.878op/s] or [+4.138%; +11.747%]	18.447ms	265.344op/s	19.923ms	245.820op/s
scenario:load:petclinic:iast:high_load	better [-2.286ms; -1.996ms] or [-11.354%; -9.917%]	better [+19.464op/s; +38.175op/s] or [+8.002%; +15.694%]	17.990ms	272.066op/s	20.131ms	243.246op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~efa6975220, baseline=1.55.0-SNAPSHOT~316ea27225
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.331 ms) : 1323, 1340
.   : milestone, 1331,
iast (4.263 ms) : 4232, 4295
.   : milestone, 4263,
iast_FULL (7.493 ms) : 7437, 7548
.   : milestone, 7493,
iast_GLOBAL (4.487 ms) : 4453, 4521
.   : milestone, 4487,
profiling (3.276 ms) : 3256, 3296
.   : milestone, 3276,
tracing (2.828 ms) : 2810, 2846
.   : milestone, 2828,
section candidate
no_agent (1.345 ms) : 1336, 1353
.   : milestone, 1345,
iast (4.116 ms) : 4087, 4144
.   : milestone, 4116,
iast_FULL (7.315 ms) : 7263, 7368
.   : milestone, 7315,
iast_GLOBAL (4.482 ms) : 4445, 4518
.   : milestone, 4482,
profiling (2.875 ms) : 2857, 2893
.   : milestone, 2875,
tracing (2.668 ms) : 2652, 2685
.   : milestone, 2668,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.331 ms [1.323 ms, 1.34 ms]	-
iast	4.263 ms [4.232 ms, 4.295 ms]	2.932 ms (220.2%)
iast_FULL	7.493 ms [7.437 ms, 7.548 ms]	6.161 ms (462.8%)
iast_GLOBAL	4.487 ms [4.453 ms, 4.521 ms]	3.156 ms (237.0%)
profiling	3.276 ms [3.256 ms, 3.296 ms]	1.945 ms (146.1%)
tracing	2.828 ms [2.81 ms, 2.846 ms]	1.497 ms (112.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.345 ms [1.336 ms, 1.353 ms]	-
iast	4.116 ms [4.087 ms, 4.144 ms]	2.771 ms (206.1%)
iast_FULL	7.315 ms [7.263 ms, 7.368 ms]	5.971 ms (444.0%)
iast_GLOBAL	4.482 ms [4.445 ms, 4.518 ms]	3.137 ms (233.3%)
profiling	2.875 ms [2.857 ms, 2.893 ms]	1.53 ms (113.8%)
tracing	2.668 ms [2.652 ms, 2.685 ms]	1.324 ms (98.4%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~efa6975220, baseline=1.55.0-SNAPSHOT~316ea27225
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.091 ms) : 16974, 17209
.   : milestone, 17091,
appsec (18.887 ms) : 18752, 19022
.   : milestone, 18887,
code_origins (19.923 ms) : 19784, 20061
.   : milestone, 19923,
iast (20.131 ms) : 19989, 20273
.   : milestone, 20131,
profiling (20.275 ms) : 20132, 20418
.   : milestone, 20275,
tracing (19.481 ms) : 19343, 19619
.   : milestone, 19481,
section candidate
no_agent (19.017 ms) : 18885, 19148
.   : milestone, 19017,
appsec (20.905 ms) : 20756, 21054
.   : milestone, 20905,
code_origins (18.447 ms) : 18315, 18578
.   : milestone, 18447,
iast (17.99 ms) : 17864, 18116
.   : milestone, 17990,
profiling (18.441 ms) : 18311, 18571
.   : milestone, 18441,
tracing (19.53 ms) : 19391, 19669
.   : milestone, 19530,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.091 ms [16.974 ms, 17.209 ms]	-
appsec	18.887 ms [18.752 ms, 19.022 ms]	1.796 ms (10.5%)
code_origins	19.923 ms [19.784 ms, 20.061 ms]	2.831 ms (16.6%)
iast	20.131 ms [19.989 ms, 20.273 ms]	3.04 ms (17.8%)
profiling	20.275 ms [20.132 ms, 20.418 ms]	3.184 ms (18.6%)
tracing	19.481 ms [19.343 ms, 19.619 ms]	2.39 ms (14.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.017 ms [18.885 ms, 19.148 ms]	-
appsec	20.905 ms [20.756 ms, 21.054 ms]	1.888 ms (9.9%)
code_origins	18.447 ms [18.315 ms, 18.578 ms]	-570.41 µs (-3.0%)
iast	17.99 ms [17.864 ms, 18.116 ms]	-1.027 ms (-5.4%)
profiling	18.441 ms [18.311 ms, 18.571 ms]	-575.846 µs (-3.0%)
tracing	19.53 ms [19.391 ms, 19.669 ms]	513.019 µs (2.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	augusto/benchmark-load-experiments
git_commit_date	1760603875	1760606690
git_commit_sha	316ea27225	efa6975220
release_version	1.55.0-SNAPSHOT~316ea27225	1.54.0-SNAPSHOT~efa6975220

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1760608849	1760608849
ci_job_id	1182186299	1182186299
ci_pipeline_id	79465786	79465786
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-o0wmr0uf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-o0wmr0uf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~efa6975220, baseline=1.55.0-SNAPSHOT~316ea27225
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.011 s) : 15011000, 15011000
.   : milestone, 15011000,
appsec (14.919 s) : 14919000, 14919000
.   : milestone, 14919000,
iast (18.66 s) : 18660000, 18660000
.   : milestone, 18660000,
iast_GLOBAL (18.231 s) : 18231000, 18231000
.   : milestone, 18231000,
profiling (15.094 s) : 15094000, 15094000
.   : milestone, 15094000,
tracing (14.974 s) : 14974000, 14974000
.   : milestone, 14974000,
section candidate
no_agent (15.258 s) : 15258000, 15258000
.   : milestone, 15258000,
appsec (14.905 s) : 14905000, 14905000
.   : milestone, 14905000,
iast (18.458 s) : 18458000, 18458000
.   : milestone, 18458000,
iast_GLOBAL (18.002 s) : 18002000, 18002000
.   : milestone, 18002000,
profiling (15.426 s) : 15426000, 15426000
.   : milestone, 15426000,
tracing (15.088 s) : 15088000, 15088000
.   : milestone, 15088000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.011 s [15.011 s, 15.011 s]	-
appsec	14.919 s [14.919 s, 14.919 s]	-92.0 ms (-0.6%)
iast	18.66 s [18.66 s, 18.66 s]	3.649 s (24.3%)
iast_GLOBAL	18.231 s [18.231 s, 18.231 s]	3.22 s (21.5%)
profiling	15.094 s [15.094 s, 15.094 s]	83.0 ms (0.6%)
tracing	14.974 s [14.974 s, 14.974 s]	-37.0 ms (-0.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.258 s [15.258 s, 15.258 s]	-
appsec	14.905 s [14.905 s, 14.905 s]	-353.0 ms (-2.3%)
iast	18.458 s [18.458 s, 18.458 s]	3.2 s (21.0%)
iast_GLOBAL	18.002 s [18.002 s, 18.002 s]	2.744 s (18.0%)
profiling	15.426 s [15.426 s, 15.426 s]	168.0 ms (1.1%)
tracing	15.088 s [15.088 s, 15.088 s]	-170.0 ms (-1.1%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~efa6975220, baseline=1.55.0-SNAPSHOT~316ea27225
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.484 ms) : 1473, 1496
.   : milestone, 1484,
appsec (3.757 ms) : 3538, 3976
.   : milestone, 3757,
iast (2.222 ms) : 2158, 2287
.   : milestone, 2222,
iast_GLOBAL (2.261 ms) : 2197, 2326
.   : milestone, 2261,
profiling (2.057 ms) : 2006, 2108
.   : milestone, 2057,
tracing (2.04 ms) : 1990, 2090
.   : milestone, 2040,
section candidate
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.716 ms) : 3499, 3933
.   : milestone, 3716,
iast (2.207 ms) : 2145, 2270
.   : milestone, 2207,
iast_GLOBAL (2.247 ms) : 2184, 2311
.   : milestone, 2247,
profiling (2.041 ms) : 1991, 2091
.   : milestone, 2041,
tracing (2.025 ms) : 1977, 2074
.   : milestone, 2025,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.484 ms [1.473 ms, 1.496 ms]	-
appsec	3.757 ms [3.538 ms, 3.976 ms]	2.273 ms (153.1%)
iast	2.222 ms [2.158 ms, 2.287 ms]	738.221 µs (49.7%)
iast_GLOBAL	2.261 ms [2.197 ms, 2.326 ms]	777.081 µs (52.4%)
profiling	2.057 ms [2.006 ms, 2.108 ms]	572.557 µs (38.6%)
tracing	2.04 ms [1.99 ms, 2.09 ms]	555.945 µs (37.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.468 ms, 1.491 ms]	-
appsec	3.716 ms [3.499 ms, 3.933 ms]	2.237 ms (151.2%)
iast	2.207 ms [2.145 ms, 2.27 ms]	728.191 µs (49.2%)
iast_GLOBAL	2.247 ms [2.184 ms, 2.311 ms]	768.16 µs (51.9%)
profiling	2.041 ms [1.991 ms, 2.091 ms]	561.495 µs (38.0%)
tracing	2.025 ms [1.977 ms, 2.074 ms]	546.246 µs (36.9%)

Sep 19 '25 12:09 pr-commenter[bot]

increase load benchmark scenario durations

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary