What Does This Do

DRAFT

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

Jul 17 '25 06:07 PerfectSlayer

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/environment
git_commit_date	1761123017	1761124070
git_commit_sha	30451d7c0a	80138dd9f8
release_version	1.55.0-SNAPSHOT~30451d7c0a	1.55.0-SNAPSHOT~80138dd9f8

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761126896	1761126896
ci_job_id	1190893588	1190893588
ci_pipeline_id	79931394	79931394
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-8gcfz1ux 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-8gcfz1ux 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~80138dd9f8, baseline=1.55.0-SNAPSHOT~30451d7c0a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1019673
Total [baseline] (8.65 s) : 0, 8650399
Agent [candidate] (1.026 s) : 0, 1025793
Total [candidate] (8.662 s) : 0, 8662500
section iast
Agent [baseline] (1.153 s) : 0, 1152658
Total [baseline] (9.265 s) : 0, 9264804
Agent [candidate] (1.165 s) : 0, 1165037
Total [candidate] (9.293 s) : 0, 9293204

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.02 s	-
Agent	iast	1.153 s	132.985 ms (13.0%)
Total	tracing	8.65 s	-
Total	iast	9.265 s	614.405 ms (7.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.026 s	-
Agent	iast	1.165 s	139.244 ms (13.6%)
Total	tracing	8.662 s	-
Total	iast	9.293 s	630.704 ms (7.3%)

gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~80138dd9f8, baseline=1.55.0-SNAPSHOT~30451d7c0a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.46 ms) : 0, 1460
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (694.834 ms) : 0, 694834
BytebuddyAgent [candidate] (698.844 ms) : 0, 698844
GlobalTracer [baseline] (243.162 ms) : 0, 243162
GlobalTracer [candidate] (244.201 ms) : 0, 244201
AppSec [baseline] (32.493 ms) : 0, 32493
AppSec [candidate] (32.564 ms) : 0, 32564
Debugger [baseline] (6.322 ms) : 0, 6322
Debugger [candidate] (6.343 ms) : 0, 6343
Remote Config [baseline] (684.522 µs) : 0, 685
Remote Config [candidate] (679.354 µs) : 0, 679
Telemetry [baseline] (9.282 ms) : 0, 9282
Telemetry [candidate] (9.377 ms) : 0, 9377
Flare Poller [baseline] (10.336 ms) : 0, 10336
Flare Poller [candidate] (11.054 ms) : 0, 11054
section iast
crashtracking [baseline] (1.487 ms) : 0, 1487
crashtracking [candidate] (1.485 ms) : 0, 1485
BytebuddyAgent [baseline] (815.918 ms) : 0, 815918
BytebuddyAgent [candidate] (825.818 ms) : 0, 825818
GlobalTracer [baseline] (231.725 ms) : 0, 231725
GlobalTracer [candidate] (233.895 ms) : 0, 233895
AppSec [baseline] (35.285 ms) : 0, 35285
AppSec [candidate] (35.227 ms) : 0, 35227
Debugger [baseline] (6.194 ms) : 0, 6194
Debugger [candidate] (6.204 ms) : 0, 6204
Remote Config [baseline] (628.727 µs) : 0, 629
Remote Config [candidate] (606.216 µs) : 0, 606
Telemetry [baseline] (8.863 ms) : 0, 8863
Telemetry [candidate] (8.833 ms) : 0, 8833
Flare Poller [baseline] (4.305 ms) : 0, 4305
Flare Poller [candidate] (4.279 ms) : 0, 4279
IAST [baseline] (26.878 ms) : 0, 26878
IAST [candidate] (27.056 ms) : 0, 27056

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~80138dd9f8, baseline=1.55.0-SNAPSHOT~30451d7c0a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1021002
Total [baseline] (10.696 s) : 0, 10695889
Agent [candidate] (1.017 s) : 0, 1016976
Total [candidate] (10.72 s) : 0, 10719846
section appsec
Agent [baseline] (1.194 s) : 0, 1194462
Total [baseline] (10.874 s) : 0, 10874037
Agent [candidate] (1.193 s) : 0, 1192932
Total [candidate] (10.813 s) : 0, 10812976
section iast
Agent [baseline] (1.151 s) : 0, 1150864
Total [baseline] (11.109 s) : 0, 11109037
Agent [candidate] (1.159 s) : 0, 1159060
Total [candidate] (11.211 s) : 0, 11210793
section profiling
Agent [baseline] (1.167 s) : 0, 1167059
Total [baseline] (10.805 s) : 0, 10804668
Agent [candidate] (1.171 s) : 0, 1170824
Total [candidate] (10.962 s) : 0, 10961886

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.021 s	-
Agent	appsec	1.194 s	173.46 ms (17.0%)
Agent	iast	1.151 s	129.862 ms (12.7%)
Agent	profiling	1.167 s	146.056 ms (14.3%)
Total	tracing	10.696 s	-
Total	appsec	10.874 s	178.148 ms (1.7%)
Total	iast	11.109 s	413.148 ms (3.9%)
Total	profiling	10.805 s	108.78 ms (1.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.017 s	-
Agent	appsec	1.193 s	175.956 ms (17.3%)
Agent	iast	1.159 s	142.084 ms (14.0%)
Agent	profiling	1.171 s	153.848 ms (15.1%)
Total	tracing	10.72 s	-
Total	appsec	10.813 s	93.131 ms (0.9%)
Total	iast	11.211 s	490.947 ms (4.6%)
Total	profiling	10.962 s	242.04 ms (2.3%)

gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~80138dd9f8, baseline=1.55.0-SNAPSHOT~30451d7c0a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.473 ms) : 0, 1473
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (695.923 ms) : 0, 695923
BytebuddyAgent [candidate] (693.495 ms) : 0, 693495
GlobalTracer [baseline] (243.391 ms) : 0, 243391
GlobalTracer [candidate] (242.861 ms) : 0, 242861
AppSec [baseline] (32.368 ms) : 0, 32368
AppSec [candidate] (32.23 ms) : 0, 32230
Debugger [baseline] (6.329 ms) : 0, 6329
Debugger [candidate] (6.274 ms) : 0, 6274
Remote Config [baseline] (673.978 µs) : 0, 674
Remote Config [candidate] (677.214 µs) : 0, 677
Telemetry [baseline] (9.368 ms) : 0, 9368
Telemetry [candidate] (9.289 ms) : 0, 9289
Flare Poller [baseline] (10.31 ms) : 0, 10310
Flare Poller [candidate] (9.565 ms) : 0, 9565
section appsec
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.482 ms) : 0, 1482
BytebuddyAgent [baseline] (717.526 ms) : 0, 717526
BytebuddyAgent [candidate] (717.091 ms) : 0, 717091
GlobalTracer [baseline] (234.991 ms) : 0, 234991
GlobalTracer [candidate] (234.664 ms) : 0, 234664
AppSec [baseline] (174.457 ms) : 0, 174457
AppSec [candidate] (174.467 ms) : 0, 174467
Debugger [baseline] (6.021 ms) : 0, 6021
Debugger [candidate] (6.096 ms) : 0, 6096
Remote Config [baseline] (641.322 µs) : 0, 641
Remote Config [candidate] (634.088 µs) : 0, 634
Telemetry [baseline] (9.301 ms) : 0, 9301
Telemetry [candidate] (8.519 ms) : 0, 8519
Flare Poller [baseline] (3.89 ms) : 0, 3890
Flare Poller [candidate] (3.919 ms) : 0, 3919
IAST [baseline] (25.029 ms) : 0, 25029
IAST [candidate] (24.85 ms) : 0, 24850
section iast
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.493 ms) : 0, 1493
BytebuddyAgent [baseline] (814.834 ms) : 0, 814834
BytebuddyAgent [candidate] (820.439 ms) : 0, 820439
GlobalTracer [baseline] (231.471 ms) : 0, 231471
GlobalTracer [candidate] (232.934 ms) : 0, 232934
AppSec [baseline] (35.31 ms) : 0, 35310
AppSec [candidate] (35.411 ms) : 0, 35411
Debugger [baseline] (6.108 ms) : 0, 6108
Debugger [candidate] (6.26 ms) : 0, 6260
Remote Config [baseline] (601.229 µs) : 0, 601
Remote Config [candidate] (616.773 µs) : 0, 617
Telemetry [baseline] (8.681 ms) : 0, 8681
Telemetry [candidate] (8.876 ms) : 0, 8876
Flare Poller [baseline] (4.257 ms) : 0, 4257
Flare Poller [candidate] (4.324 ms) : 0, 4324
IAST [baseline] (26.67 ms) : 0, 26670
IAST [candidate] (27.162 ms) : 0, 27162
section profiling
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.466 ms) : 0, 1466
BytebuddyAgent [baseline] (722.539 ms) : 0, 722539
BytebuddyAgent [candidate] (724.472 ms) : 0, 724472
GlobalTracer [baseline] (219.657 ms) : 0, 219657
GlobalTracer [candidate] (219.404 ms) : 0, 219404
AppSec [baseline] (32.409 ms) : 0, 32409
AppSec [candidate] (32.485 ms) : 0, 32485
Debugger [baseline] (6.601 ms) : 0, 6601
Debugger [candidate] (8.195 ms) : 0, 8195
Remote Config [baseline] (681.182 µs) : 0, 681
Remote Config [candidate] (705.364 µs) : 0, 705
Telemetry [baseline] (15.876 ms) : 0, 15876
Telemetry [candidate] (14.664 ms) : 0, 14664
Flare Poller [baseline] (4.143 ms) : 0, 4143
Flare Poller [candidate] (4.198 ms) : 0, 4198
ProfilingAgent [baseline] (109.838 ms) : 0, 109838
ProfilingAgent [candidate] (111.187 ms) : 0, 111187
Profiling [baseline] (110.47 ms) : 0, 110470
Profiling [candidate] (111.824 ms) : 0, 111824

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/environment
git_commit_date	1761123017	1761124070
git_commit_sha	30451d7c0a	80138dd9f8
release_version	1.55.0-SNAPSHOT~30451d7c0a	1.55.0-SNAPSHOT~80138dd9f8

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761126563	1761126563
ci_job_id	1190893590	1190893590
ci_pipeline_id	79931394	79931394
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-r6c3pvpx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-r6c3pvpx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load	better [-260.595µs; -151.560µs] or [-5.723%; -3.328%]	unstable [-68.217op/s; +161.217op/s] or [-6.763%; +15.983%]	4.348ms	1055.156op/s	4.554ms	1008.656op/s
scenario:load:insecure-bank:iast:high_load	worse [+763.955µs; +1110.381µs] or [+8.314%; +12.084%]	unstable [-104.031op/s; +11.406op/s] or [-20.599%; +2.258%]	10.126ms	458.719op/s	9.189ms	505.031op/s
scenario:load:insecure-bank:tracing:high_load	better [-827.850µs; -558.865µs] or [-9.765%; -6.592%]	unstable [-24.104op/s; +120.479op/s] or [-4.409%; +22.035%]	7.784ms	594.938op/s	8.478ms	546.750op/s
scenario:load:petclinic:appsec:high_load	worse [+0.961ms; +1.860ms] or [+2.063%; +3.993%]	unstable [-9.672op/s; +3.772op/s] or [-9.628%; +3.755%]	47.989ms	97.500op/s	46.579ms	100.450op/s
scenario:load:petclinic:profiling:high_load	better [-2.952ms; -1.994ms] or [-5.874%; -3.968%]	unstable [-1.910op/s; +11.535op/s] or [-2.051%; +12.390%]	47.787ms	97.912op/s	50.261ms	93.100op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~80138dd9f8, baseline=1.55.0-SNAPSHOT~30451d7c0a
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.962 ms) : 36660, 37265
.   : milestone, 36962,
appsec (46.579 ms) : 46176, 46982
.   : milestone, 46579,
code_origins (42.866 ms) : 42503, 43228
.   : milestone, 42866,
iast (46.453 ms) : 46043, 46862
.   : milestone, 46453,
profiling (50.261 ms) : 49792, 50730
.   : milestone, 50261,
tracing (43.642 ms) : 43282, 44002
.   : milestone, 43642,
section candidate
no_agent (37.314 ms) : 37018, 37610
.   : milestone, 37314,
appsec (47.989 ms) : 47557, 48422
.   : milestone, 47989,
code_origins (42.767 ms) : 42401, 43133
.   : milestone, 42767,
iast (46.114 ms) : 45712, 46516
.   : milestone, 46114,
profiling (47.787 ms) : 47367, 48207
.   : milestone, 47787,
tracing (43.975 ms) : 43585, 44365
.   : milestone, 43975,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.962 ms [36.66 ms, 37.265 ms]	-
appsec	46.579 ms [46.176 ms, 46.982 ms]	9.617 ms (26.0%)
code_origins	42.866 ms [42.503 ms, 43.228 ms]	5.903 ms (16.0%)
iast	46.453 ms [46.043 ms, 46.862 ms]	9.49 ms (25.7%)
profiling	50.261 ms [49.792 ms, 50.73 ms]	13.298 ms (36.0%)
tracing	43.642 ms [43.282 ms, 44.002 ms]	6.68 ms (18.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.314 ms [37.018 ms, 37.61 ms]	-
appsec	47.989 ms [47.557 ms, 48.422 ms]	10.675 ms (28.6%)
code_origins	42.767 ms [42.401 ms, 43.133 ms]	5.453 ms (14.6%)
iast	46.114 ms [45.712 ms, 46.516 ms]	8.8 ms (23.6%)
profiling	47.787 ms [47.367 ms, 48.207 ms]	10.473 ms (28.1%)
tracing	43.975 ms [43.585 ms, 44.365 ms]	6.66 ms (17.8%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~80138dd9f8, baseline=1.55.0-SNAPSHOT~30451d7c0a
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.554 ms) : 4502, 4605
.   : milestone, 4554,
iast (9.189 ms) : 9037, 9341
.   : milestone, 9189,
iast_FULL (14.77 ms) : 14472, 15068
.   : milestone, 14770,
iast_GLOBAL (10.28 ms) : 10096, 10464
.   : milestone, 10280,
profiling (8.81 ms) : 8676, 8944
.   : milestone, 8810,
tracing (8.478 ms) : 8352, 8603
.   : milestone, 8478,
section candidate
no_agent (4.348 ms) : 4298, 4397
.   : milestone, 4348,
iast (10.126 ms) : 9956, 10296
.   : milestone, 10126,
iast_FULL (14.298 ms) : 14011, 14584
.   : milestone, 14298,
iast_GLOBAL (10.134 ms) : 9958, 10310
.   : milestone, 10134,
profiling (8.802 ms) : 8664, 8940
.   : milestone, 8802,
tracing (7.784 ms) : 7660, 7909
.   : milestone, 7784,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.554 ms [4.502 ms, 4.605 ms]	-
iast	9.189 ms [9.037 ms, 9.341 ms]	4.635 ms (101.8%)
iast_FULL	14.77 ms [14.472 ms, 15.068 ms]	10.217 ms (224.4%)
iast_GLOBAL	10.28 ms [10.096 ms, 10.464 ms]	5.727 ms (125.8%)
profiling	8.81 ms [8.676 ms, 8.944 ms]	4.256 ms (93.5%)
tracing	8.478 ms [8.352 ms, 8.603 ms]	3.924 ms (86.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.348 ms [4.298 ms, 4.397 ms]	-
iast	10.126 ms [9.956 ms, 10.296 ms]	5.778 ms (132.9%)
iast_FULL	14.298 ms [14.011 ms, 14.584 ms]	9.95 ms (228.9%)
iast_GLOBAL	10.134 ms [9.958 ms, 10.31 ms]	5.787 ms (133.1%)
profiling	8.802 ms [8.664 ms, 8.94 ms]	4.454 ms (102.5%)
tracing	7.784 ms [7.66 ms, 7.909 ms]	3.437 ms (79.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/environment
git_commit_date	1761123017	1761124070
git_commit_sha	30451d7c0a	80138dd9f8
release_version	1.55.0-SNAPSHOT~30451d7c0a	1.55.0-SNAPSHOT~80138dd9f8

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1761127121	1761127121
ci_job_id	1190893593	1190893593
ci_pipeline_id	79931394	79931394
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-easpax5g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-easpax5g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.444ms; -1.097ms] or [-38.038%; -28.910%]	2.525ms	3.795ms

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~80138dd9f8, baseline=1.55.0-SNAPSHOT~30451d7c0a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.795 ms) : 3574, 4017
.   : milestone, 3795,
iast (2.229 ms) : 2165, 2293
.   : milestone, 2229,
iast_GLOBAL (2.265 ms) : 2201, 2329
.   : milestone, 2265,
profiling (2.082 ms) : 2030, 2135
.   : milestone, 2082,
tracing (2.04 ms) : 1990, 2089
.   : milestone, 2040,
section candidate
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (2.525 ms) : 2471, 2579
.   : milestone, 2525,
iast (2.232 ms) : 2167, 2296
.   : milestone, 2232,
iast_GLOBAL (2.258 ms) : 2194, 2322
.   : milestone, 2258,
profiling (2.07 ms) : 2018, 2121
.   : milestone, 2070,
tracing (2.026 ms) : 1976, 2075
.   : milestone, 2026,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.468 ms, 1.491 ms]	-
appsec	3.795 ms [3.574 ms, 4.017 ms]	2.316 ms (156.6%)
iast	2.229 ms [2.165 ms, 2.293 ms]	750.072 µs (50.7%)
iast_GLOBAL	2.265 ms [2.201 ms, 2.329 ms]	785.497 µs (53.1%)
profiling	2.082 ms [2.03 ms, 2.135 ms]	603.102 µs (40.8%)
tracing	2.04 ms [1.99 ms, 2.089 ms]	560.594 µs (37.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.49 ms]	-
appsec	2.525 ms [2.471 ms, 2.579 ms]	1.046 ms (70.8%)
iast	2.232 ms [2.167 ms, 2.296 ms]	752.892 µs (50.9%)
iast_GLOBAL	2.258 ms [2.194 ms, 2.322 ms]	779.063 µs (52.7%)
profiling	2.07 ms [2.018 ms, 2.121 ms]	590.926 µs (40.0%)
tracing	2.026 ms [1.976 ms, 2.075 ms]	546.955 µs (37.0%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~80138dd9f8, baseline=1.55.0-SNAPSHOT~30451d7c0a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.07 s) : 15070000, 15070000
.   : milestone, 15070000,
appsec (15.216 s) : 15216000, 15216000
.   : milestone, 15216000,
iast (18.678 s) : 18678000, 18678000
.   : milestone, 18678000,
iast_GLOBAL (18.099 s) : 18099000, 18099000
.   : milestone, 18099000,
profiling (15.407 s) : 15407000, 15407000
.   : milestone, 15407000,
tracing (14.818 s) : 14818000, 14818000
.   : milestone, 14818000,
section candidate
no_agent (15.497 s) : 15497000, 15497000
.   : milestone, 15497000,
appsec (14.814 s) : 14814000, 14814000
.   : milestone, 14814000,
iast (18.581 s) : 18581000, 18581000
.   : milestone, 18581000,
iast_GLOBAL (17.77 s) : 17770000, 17770000
.   : milestone, 17770000,
profiling (15.737 s) : 15737000, 15737000
.   : milestone, 15737000,
tracing (15.133 s) : 15133000, 15133000
.   : milestone, 15133000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.07 s [15.07 s, 15.07 s]	-
appsec	15.216 s [15.216 s, 15.216 s]	146.0 ms (1.0%)
iast	18.678 s [18.678 s, 18.678 s]	3.608 s (23.9%)
iast_GLOBAL	18.099 s [18.099 s, 18.099 s]	3.029 s (20.1%)
profiling	15.407 s [15.407 s, 15.407 s]	337.0 ms (2.2%)
tracing	14.818 s [14.818 s, 14.818 s]	-252.0 ms (-1.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.497 s [15.497 s, 15.497 s]	-
appsec	14.814 s [14.814 s, 14.814 s]	-683.0 ms (-4.4%)
iast	18.581 s [18.581 s, 18.581 s]	3.084 s (19.9%)
iast_GLOBAL	17.77 s [17.77 s, 17.77 s]	2.273 s (14.7%)
profiling	15.737 s [15.737 s, 15.737 s]	240.0 ms (1.5%)
tracing	15.133 s [15.133 s, 15.133 s]	-364.0 ms (-2.3%)

Jul 17 '25 07:07 pr-commenter[bot]

Debugger benchmarks

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
ci_job_date	1753098245	1753098591
end_time	2025-07-21T11:45:26	2025-07-21T11:51:11
git_branch	master	bbujon/environment
git_commit_sha	9b8db749f5	d6ef7876f86a9709d762b829f1298956a0781079
start_time	2025-07-21T11:44:06	2025-07-21T11:49:51

See matching parameters

	Baseline	Candidate
ci_job_id	1038381029	1038381029
ci_pipeline_id	71152669	71152669
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date	1753096878	1753096878

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 7 unstable metrics.

See unchanged results

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:noprobe	unstable [-41.467µs; +75.820µs] or [-14.663%; +26.810%]	unstable [-48.800µs; +95.607µs] or [-15.126%; +29.635%]	unstable [-62.154µs; +123.518µs] or [-18.402%; +36.569%]	unstable [-307.360µs; +793.334µs] or [-33.038%; +85.275%]	unstable [-128.354op/s; +128.354op/s] or [-5.198%; +5.198%]
scenario:basic	same	same	same	unstable [-128.385µs; +80.104µs] or [-17.047%; +10.636%]	unstable [-205.409op/s; +205.409op/s] or [-7.806%; +7.806%]
scenario:loop	unsure [+1.877µs; +12.655µs] or [+0.021%; +0.143%]	same	same	same	same

Request duration reports for reports

gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (322.618 µs) : 282, 363
.   : milestone, 323,
basic (277.085 µs) : 271, 283
.   : milestone, 277,
loop (8.966 ms) : 8961, 8971
.   : milestone, 8966,
section candidate
noprobe (346.021 µs) : 258, 435
.   : milestone, 346,
basic (283.809 µs) : 273, 295
.   : milestone, 284,
loop (8.968 ms) : 8961, 8976
.   : milestone, 8968,

baseline results

Scenario	Request median duration [CI 0.99]
noprobe	322.618 µs [282.373 µs, 362.862 µs]
basic	277.085 µs [271.241 µs, 282.929 µs]
loop	8.966 ms [8.961 ms, 8.971 ms]

candidate results

Scenario	Request median duration [CI 0.99]
noprobe	346.021 µs [257.536 µs, 434.506 µs]
basic	283.809 µs [272.828 µs, 294.789 µs]
loop	8.968 ms [8.961 ms, 8.976 ms]

Jul 18 '25 09:07 pr-commenter[bot]

🎯 Code Coverage
• Patch Coverage: 0.00%
• Total Coverage: 59.27% (-0.44%)
View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 80138dd | Docs | Was this helpful? Give us feedback!}

Oct 22 '25 09:10 datadog-datadog-prod-us1[bot]

Environment component dev

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Debugger benchmarks

Parameters

Summary