dd-trace-java
dd-trace-java copied to clipboard
DataDog
Adding Config Registry Linter to Ensure Alias Keys Are Documented
What Does This Do
This PR adds a new Gradle task to ensure that all alias keys in the supported-configurations.json file are also defined and documented in the supportedConfigurations key.
Motivation
Additional Notes
Contributor Checklist
- Format the title according the contribution guidelines
- Assign the
type:and (comp:orinst:) labels in addition to any useful labels - Don't use
close,fixor any linking keywords when referencing an issue.
Usesolvesinstead, and assign the PR milestone to the issue - Update the CODEOWNERS file on source file addition, move, or deletion
- Update the public documentation in case of new configuration flag or behavior
Jira ticket: [PROJ-IDENT]
Hi! 👋 Thanks for your pull request! 🎉
To help us review it, please make sure to:
- Add at least one type, and one component or instrumentation label to the pull request
If you need help, please check our contributing guidelines.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
Benchmarks
⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | mhlidd/additional_config_inversion_linters |
| git_commit_date | 1765312339 | 1764714156 |
| git_commit_sha | 6836076eba | f907aa74c8 |
| release_version | 1.57.0-SNAPSHOT~6836076eba | 1.57.0-SNAPSHOT~f907aa74c8 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1765315715 | 1765315715 |
| ci_job_id | 1281564882 | 1281564882 |
| ci_pipeline_id | 85753656 | 85753656 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-ysds0v7k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-ysds0v7k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 16 performance improvements and 20 performance regressions! Performance is the same for 17 metrics, 12 unstable metrics.
| scenario | Δ mean execution_time | candidate mean execution_time | baseline mean execution_time |
|---|---|---|---|
| scenario:startup:insecure-bank:iast:crashtracking | worse [+291.741µs; +315.205µs] or [+24.402%; +26.364%] |
1.499ms | 1.196ms |
| scenario:startup:insecure-bank:iast:BytebuddyAgent | worse [+39.308ms; +45.633ms] or [+4.970%; +5.770%] |
833.368ms | 790.898ms |
| scenario:startup:insecure-bank:iast:GlobalTracer | better [-18.226ms; -16.290ms] or [-7.128%; -6.371%] |
238.437ms | 255.696ms |
| scenario:startup:insecure-bank:iast:Debugger | better [-58.569ms; -57.960ms] or [-90.974%; -90.027%] |
6.116ms | 64.380ms |
| scenario:startup:insecure-bank:iast:Remote Config | worse [+52.993µs; +87.136µs] or [+9.682%; +15.920%] |
617.408µs | 547.344µs |
| scenario:startup:insecure-bank:iast:Telemetry | better [-546.533µs; -266.300µs] or [-6.484%; -3.160%] |
8.022ms | 8.428ms |
| scenario:startup:insecure-bank:tracing:Agent.start | better [-42.121ms; -24.150ms] or [-3.882%; -2.226%] |
1.052s | 1.085s |
| scenario:startup:insecure-bank:tracing:crashtracking | worse [+272.382µs; +300.351µs] or [+22.721%; +25.054%] |
1.485ms | 1.199ms |
| scenario:startup:insecure-bank:tracing:BytebuddyAgent | worse [+51.612ms; +60.570ms] or [+7.929%; +9.305%] |
707.034ms | 650.943ms |
| scenario:startup:insecure-bank:tracing:GlobalTracer | better [-38.108ms; -31.666ms] or [-13.428%; -11.157%] |
248.920ms | 283.807ms |
| scenario:startup:insecure-bank:tracing:Debugger | better [-61.967ms; -59.877ms] or [-92.032%; -88.929%] |
6.410ms | 67.332ms |
| scenario:startup:insecure-bank:tracing:Telemetry | worse [+6.888ms; +7.602ms] or [+76.211%; +84.111%] |
16.282ms | 9.038ms |
| scenario:startup:insecure-bank:tracing:Flare Poller | worse [+278.833µs; +621.098µs] or [+7.547%; +16.810%] |
4.145ms | 3.695ms |
| scenario:startup:petclinic:appsec:Agent.start | better [-74.415ms; -32.969ms] or [-5.794%; -2.567%] |
1.231s | 1.284s |
| scenario:startup:petclinic:appsec:crashtracking | worse [+225.483µs; +280.024µs] or [+18.373%; +22.817%] |
1.480ms | 1.227ms |
| scenario:startup:petclinic:appsec:BytebuddyAgent | worse [+17.999ms; +43.941ms] or [+2.568%; +6.268%] |
731.964ms | 700.994ms |
| scenario:startup:petclinic:appsec:GlobalTracer | better [-25.210ms; -17.204ms] or [-9.574%; -6.534%] |
242.103ms | 263.310ms |
| scenario:startup:petclinic:appsec:Debugger | better [-61.954ms; -59.759ms] or [-92.204%; -88.938%] |
6.336ms | 67.192ms |
| scenario:startup:petclinic:appsec:Telemetry | better [-1119.047µs; -592.015µs] or [-12.344%; -6.530%] |
8.210ms | 9.065ms |
| scenario:startup:petclinic:iast:crashtracking | worse [+203.133µs; +272.609µs] or [+16.363%; +21.960%] |
1.479ms | 1.241ms |
| scenario:startup:petclinic:iast:BytebuddyAgent | worse [+22.732ms; +46.483ms] or [+2.850%; +5.827%] |
832.269ms | 797.662ms |
| scenario:startup:petclinic:iast:GlobalTracer | better [-23.718ms; -17.163ms] or [-9.187%; -6.648%] |
237.730ms | 258.170ms |
| scenario:startup:petclinic:iast:Debugger | better [-61.135ms; -59.132ms] or [-92.348%; -89.321%] |
6.068ms | 66.201ms |
| scenario:startup:petclinic:iast:Telemetry | better [-633.162µs; -238.256µs] or [-7.465%; -2.809%] |
8.046ms | 8.482ms |
| scenario:startup:petclinic:profiling:ProfilingAgent | worse [+12.551ms; +14.276ms] or [+12.815%; +14.576%] |
111.358ms | 97.944ms |
| scenario:startup:petclinic:profiling:crashtracking | worse [+231.456µs; +266.243µs] or [+19.546%; +22.483%] |
1.433ms | 1.184ms |
| scenario:startup:petclinic:profiling:BytebuddyAgent | worse [+32.564ms; +38.076ms] or [+4.642%; +5.428%] |
736.821ms | 701.501ms |
| scenario:startup:petclinic:profiling:Debugger | better [-62.137ms; -61.062ms] or [-90.890%; -89.318%] |
6.765ms | 68.365ms |
| scenario:startup:petclinic:profiling:Telemetry | worse [+7.224ms; +7.678ms] or [+80.434%; +85.482%] |
16.432ms | 8.982ms |
| scenario:startup:petclinic:profiling:Flare Poller | worse [+367.576µs; +541.049µs] or [+9.855%; +14.506%] |
4.184ms | 3.730ms |
| scenario:startup:petclinic:profiling:Profiling | worse [+12.605ms; +14.353ms] or [+12.794%; +14.568%] |
112.000ms | 98.522ms |
| scenario:startup:petclinic:tracing:crashtracking | worse [+265.137µs; +330.936µs] or [+21.992%; +27.450%] |
1.504ms | 1.206ms |
| scenario:startup:petclinic:tracing:BytebuddyAgent | worse [+58.090ms; +80.325ms] or [+8.954%; +12.382%] |
717.953ms | 648.746ms |
| scenario:startup:petclinic:tracing:GlobalTracer | better [-32.033ms; -24.295ms] or [-11.393%; -8.640%] |
253.014ms | 281.178ms |
| scenario:startup:petclinic:tracing:Debugger | better [-61.677ms; -60.697ms] or [-90.971%; -89.524%] |
6.612ms | 67.799ms |
| scenario:startup:petclinic:tracing:Remote Config | worse [+27.253µs; +86.623µs] or [+4.293%; +13.644%] |
691.819µs | 634.880µs |
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~f907aa74c8, baseline=1.57.0-SNAPSHOT~6836076eba
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1079977
Total [baseline] (10.809 s) : 0, 10809259
Agent [candidate] (1.068 s) : 0, 1068228
Total [candidate] (10.747 s) : 0, 10746886
section appsec
Agent [baseline] (1.284 s) : 0, 1284353
Total [baseline] (11.15 s) : 0, 11149831
Agent [candidate] (1.231 s) : 0, 1230661
Total [candidate] (10.971 s) : 0, 10971451
section iast
Agent [baseline] (1.234 s) : 0, 1233966
Total [baseline] (11.179 s) : 0, 11179000
Agent [candidate] (1.194 s) : 0, 1193747
Total [candidate] (11.193 s) : 0, 11193262
section profiling
Agent [baseline] (1.205 s) : 0, 1205046
Total [baseline] (11.03 s) : 0, 11029952
Agent [candidate] (1.203 s) : 0, 1202958
Total [candidate] (10.963 s) : 0, 10962789
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.08 s | - |
| Agent | appsec | 1.284 s | 204.376 ms (18.9%) |
| Agent | iast | 1.234 s | 153.989 ms (14.3%) |
| Agent | profiling | 1.205 s | 125.068 ms (11.6%) |
| Total | tracing | 10.809 s | - |
| Total | appsec | 11.15 s | 340.572 ms (3.2%) |
| Total | iast | 11.179 s | 369.741 ms (3.4%) |
| Total | profiling | 11.03 s | 220.694 ms (2.0%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.068 s | - |
| Agent | appsec | 1.231 s | 162.433 ms (15.2%) |
| Agent | iast | 1.194 s | 125.519 ms (11.8%) |
| Agent | profiling | 1.203 s | 134.729 ms (12.6%) |
| Total | tracing | 10.747 s | - |
| Total | appsec | 10.971 s | 224.565 ms (2.1%) |
| Total | iast | 11.193 s | 446.376 ms (4.2%) |
| Total | profiling | 10.963 s | 215.903 ms (2.0%) |
gantt
title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~f907aa74c8, baseline=1.57.0-SNAPSHOT~6836076eba
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.206 ms) : 0, 1206
crashtracking [candidate] (1.504 ms) : 0, 1504
BytebuddyAgent [baseline] (648.746 ms) : 0, 648746
BytebuddyAgent [candidate] (717.953 ms) : 0, 717953
GlobalTracer [baseline] (281.178 ms) : 0, 281178
GlobalTracer [candidate] (253.014 ms) : 0, 253014
AppSec [baseline] (32.318 ms) : 0, 32318
AppSec [candidate] (32.8 ms) : 0, 32800
Debugger [baseline] (67.799 ms) : 0, 67799
Debugger [candidate] (6.612 ms) : 0, 6612
Remote Config [baseline] (634.88 µs) : 0, 635
Remote Config [candidate] (691.819 µs) : 0, 692
Telemetry [baseline] (8.974 ms) : 0, 8974
Telemetry [candidate] (14.84 ms) : 0, 14840
Flare Poller [baseline] (3.63 ms) : 0, 3630
Flare Poller [candidate] (5.618 ms) : 0, 5618
section appsec
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.48 ms) : 0, 1480
BytebuddyAgent [baseline] (700.994 ms) : 0, 700994
BytebuddyAgent [candidate] (731.964 ms) : 0, 731964
GlobalTracer [baseline] (263.31 ms) : 0, 263310
GlobalTracer [candidate] (242.103 ms) : 0, 242103
AppSec [baseline] (176.816 ms) : 0, 176816
AppSec [candidate] (175.912 ms) : 0, 175912
Debugger [baseline] (67.192 ms) : 0, 67192
Debugger [candidate] (6.336 ms) : 0, 6336
Remote Config [baseline] (718.432 µs) : 0, 718
Remote Config [candidate] (681.01 µs) : 0, 681
Telemetry [baseline] (9.065 ms) : 0, 9065
Telemetry [candidate] (8.21 ms) : 0, 8210
Flare Poller [baseline] (3.986 ms) : 0, 3986
Flare Poller [candidate] (4.059 ms) : 0, 4059
IAST [baseline] (25.134 ms) : 0, 25134
IAST [candidate] (24.9 ms) : 0, 24900
section iast
crashtracking [baseline] (1.241 ms) : 0, 1241
crashtracking [candidate] (1.479 ms) : 0, 1479
BytebuddyAgent [baseline] (797.662 ms) : 0, 797662
BytebuddyAgent [candidate] (832.269 ms) : 0, 832269
GlobalTracer [baseline] (258.17 ms) : 0, 258170
GlobalTracer [candidate] (237.73 ms) : 0, 237730
AppSec [baseline] (35.39 ms) : 0, 35390
AppSec [candidate] (29.502 ms) : 0, 29502
Debugger [baseline] (66.201 ms) : 0, 66201
Debugger [candidate] (6.068 ms) : 0, 6068
Remote Config [baseline] (556.556 µs) : 0, 557
Remote Config [candidate] (614.498 µs) : 0, 614
Telemetry [baseline] (8.482 ms) : 0, 8482
Telemetry [candidate] (8.046 ms) : 0, 8046
Flare Poller [baseline] (3.5 ms) : 0, 3500
Flare Poller [candidate] (11.127 ms) : 0, 11127
IAST [baseline] (27.146 ms) : 0, 27146
IAST [candidate] (32.003 ms) : 0, 32003
section profiling
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.433 ms) : 0, 1433
BytebuddyAgent [baseline] (701.501 ms) : 0, 701501
BytebuddyAgent [candidate] (736.821 ms) : 0, 736821
GlobalTracer [baseline] (220.733 ms) : 0, 220733
GlobalTracer [candidate] (223.656 ms) : 0, 223656
AppSec [baseline] (32.355 ms) : 0, 32355
AppSec [candidate] (32.202 ms) : 0, 32202
Debugger [baseline] (68.365 ms) : 0, 68365
Debugger [candidate] (6.765 ms) : 0, 6765
Remote Config [baseline] (639.272 µs) : 0, 639
Remote Config [candidate] (673.357 µs) : 0, 673
Telemetry [baseline] (8.982 ms) : 0, 8982
Telemetry [candidate] (16.432 ms) : 0, 16432
Flare Poller [baseline] (3.73 ms) : 0, 3730
Flare Poller [candidate] (4.184 ms) : 0, 4184
ProfilingAgent [baseline] (97.944 ms) : 0, 97944
ProfilingAgent [candidate] (111.358 ms) : 0, 111358
Profiling [baseline] (98.522 ms) : 0, 98522
Profiling [candidate] (112.0 ms) : 0, 112000
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~f907aa74c8, baseline=1.57.0-SNAPSHOT~6836076eba
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1084943
Total [baseline] (8.766 s) : 0, 8766052
Agent [candidate] (1.052 s) : 0, 1051807
Total [candidate] (8.704 s) : 0, 8703708
section iast
Agent [baseline] (1.222 s) : 0, 1222487
Total [baseline] (9.492 s) : 0, 9492324
Agent [candidate] (1.196 s) : 0, 1195575
Total [candidate] (9.323 s) : 0, 9322898
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.085 s | - |
| Agent | iast | 1.222 s | 137.544 ms (12.7%) |
| Total | tracing | 8.766 s | - |
| Total | iast | 9.492 s | 726.272 ms (8.3%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.052 s | - |
| Agent | iast | 1.196 s | 143.768 ms (13.7%) |
| Total | tracing | 8.704 s | - |
| Total | iast | 9.323 s | 619.19 ms (7.1%) |
gantt
title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~f907aa74c8, baseline=1.57.0-SNAPSHOT~6836076eba
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.485 ms) : 0, 1485
BytebuddyAgent [baseline] (650.943 ms) : 0, 650943
BytebuddyAgent [candidate] (707.034 ms) : 0, 707034
GlobalTracer [baseline] (283.807 ms) : 0, 283807
GlobalTracer [candidate] (248.92 ms) : 0, 248920
AppSec [baseline] (32.611 ms) : 0, 32611
AppSec [candidate] (31.98 ms) : 0, 31980
Debugger [baseline] (67.332 ms) : 0, 67332
Debugger [candidate] (6.41 ms) : 0, 6410
Remote Config [baseline] (641.399 µs) : 0, 641
Remote Config [candidate] (676.398 µs) : 0, 676
Telemetry [baseline] (9.038 ms) : 0, 9038
Telemetry [candidate] (16.282 ms) : 0, 16282
Flare Poller [baseline] (3.695 ms) : 0, 3695
Flare Poller [candidate] (4.145 ms) : 0, 4145
section iast
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.499 ms) : 0, 1499
BytebuddyAgent [baseline] (790.898 ms) : 0, 790898
BytebuddyAgent [candidate] (833.368 ms) : 0, 833368
GlobalTracer [baseline] (255.696 ms) : 0, 255696
GlobalTracer [candidate] (238.437 ms) : 0, 238437
AppSec [baseline] (35.455 ms) : 0, 35455
AppSec [candidate] (29.627 ms) : 0, 29627
Debugger [baseline] (64.38 ms) : 0, 64380
Debugger [candidate] (6.116 ms) : 0, 6116
Remote Config [baseline] (547.344 µs) : 0, 547
Remote Config [candidate] (617.408 µs) : 0, 617
Telemetry [baseline] (8.428 ms) : 0, 8428
Telemetry [candidate] (8.022 ms) : 0, 8022
Flare Poller [baseline] (3.464 ms) : 0, 3464
Flare Poller [candidate] (11.053 ms) : 0, 11053
IAST [baseline] (26.907 ms) : 0, 26907
IAST [candidate] (31.923 ms) : 0, 31923
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | mhlidd/additional_config_inversion_linters |
| git_commit_date | 1765312339 | 1764714156 |
| git_commit_sha | 6836076eba | f907aa74c8 |
| release_version | 1.57.0-SNAPSHOT~6836076eba | 1.57.0-SNAPSHOT~f907aa74c8 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1765316342 | 1765316342 |
| ci_job_id | 1281564885 | 1281564885 |
| ci_pipeline_id | 85753656 | 85753656 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-hlrwhlou 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-hlrwhlou 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 3 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.
| scenario | Δ mean agg_http_req_duration_p50 | Δ mean agg_http_req_duration_p95 | Δ mean throughput | candidate mean agg_http_req_duration_p50 | candidate mean agg_http_req_duration_p95 | candidate mean throughput | baseline mean agg_http_req_duration_p50 | baseline mean agg_http_req_duration_p95 | baseline mean throughput |
|---|---|---|---|---|---|---|---|---|---|
| scenario:load:insecure-bank:iast:high_load | worse [+102.541µs; +195.606µs] or [+4.245%; +8.098%] |
unsure [+96.232µs; +486.372µs] or [+1.348%; +6.815%] |
unstable [-240.223op/s; +73.911op/s] or [-16.273%; +5.007%] |
2.565ms | 7.428ms | 1393.031op/s | 2.416ms | 7.137ms | 1476.188op/s |
| scenario:load:insecure-bank:iast_FULL:high_load | worse [+170.730µs; +486.439µs] or [+3.344%; +9.528%] |
worse [+253.833µs; +1106.496µs] or [+2.085%; +9.089%] |
unstable [-116.244op/s; +49.306op/s] or [-14.575%; +6.182%] |
5.434ms | 12.854ms | 764.062op/s | 5.105ms | 12.174ms | 797.531op/s |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~f907aa74c8, baseline=1.57.0-SNAPSHOT~6836076eba
dateFormat X
axisFormat %s
section baseline
no_agent (1.198 ms) : 1185, 1211
. : milestone, 1198,
iast (3.096 ms) : 3063, 3128
. : milestone, 3096,
iast_FULL (5.796 ms) : 5738, 5855
. : milestone, 5796,
iast_GLOBAL (3.662 ms) : 3602, 3723
. : milestone, 3662,
profiling (2.061 ms) : 2043, 2078
. : milestone, 2061,
tracing (1.782 ms) : 1768, 1797
. : milestone, 1782,
section candidate
no_agent (1.207 ms) : 1196, 1219
. : milestone, 1207,
iast (3.286 ms) : 3241, 3331
. : milestone, 3286,
iast_FULL (6.055 ms) : 5993, 6117
. : milestone, 6055,
iast_GLOBAL (3.718 ms) : 3648, 3788
. : milestone, 3718,
profiling (1.964 ms) : 1946, 1981
. : milestone, 1964,
tracing (1.796 ms) : 1782, 1811
. : milestone, 1796,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.198 ms [1.185 ms, 1.211 ms] | - |
| iast | 3.096 ms [3.063 ms, 3.128 ms] | 1.898 ms (158.4%) |
| iast_FULL | 5.796 ms [5.738 ms, 5.855 ms] | 4.599 ms (383.9%) |
| iast_GLOBAL | 3.662 ms [3.602 ms, 3.723 ms] | 2.465 ms (205.8%) |
| profiling | 2.061 ms [2.043 ms, 2.078 ms] | 862.907 µs (72.0%) |
| tracing | 1.782 ms [1.768 ms, 1.797 ms] | 584.399 µs (48.8%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.207 ms [1.196 ms, 1.219 ms] | - |
| iast | 3.286 ms [3.241 ms, 3.331 ms] | 2.078 ms (172.1%) |
| iast_FULL | 6.055 ms [5.993 ms, 6.117 ms] | 4.848 ms (401.5%) |
| iast_GLOBAL | 3.718 ms [3.648 ms, 3.788 ms] | 2.511 ms (207.9%) |
| profiling | 1.964 ms [1.946 ms, 1.981 ms] | 756.125 µs (62.6%) |
| tracing | 1.796 ms [1.782 ms, 1.811 ms] | 588.874 µs (48.8%) |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~f907aa74c8, baseline=1.57.0-SNAPSHOT~6836076eba
dateFormat X
axisFormat %s
section baseline
no_agent (19.412 ms) : 19213, 19610
. : milestone, 19412,
appsec (18.71 ms) : 18519, 18901
. : milestone, 18710,
code_origins (17.958 ms) : 17779, 18137
. : milestone, 17958,
iast (17.784 ms) : 17608, 17960
. : milestone, 17784,
profiling (18.625 ms) : 18441, 18808
. : milestone, 18625,
tracing (18.425 ms) : 18238, 18613
. : milestone, 18425,
section candidate
no_agent (19.621 ms) : 19419, 19823
. : milestone, 19621,
appsec (18.678 ms) : 18492, 18864
. : milestone, 18678,
code_origins (18.116 ms) : 17936, 18296
. : milestone, 18116,
iast (18.49 ms) : 18303, 18677
. : milestone, 18490,
profiling (18.623 ms) : 18435, 18811
. : milestone, 18623,
tracing (18.733 ms) : 18545, 18920
. : milestone, 18733,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 19.412 ms [19.213 ms, 19.61 ms] | - |
| appsec | 18.71 ms [18.519 ms, 18.901 ms] | -701.19 µs (-3.6%) |
| code_origins | 17.958 ms [17.779 ms, 18.137 ms] | -1.453 ms (-7.5%) |
| iast | 17.784 ms [17.608 ms, 17.96 ms] | -1.628 ms (-8.4%) |
| profiling | 18.625 ms [18.441 ms, 18.808 ms] | -787.025 µs (-4.1%) |
| tracing | 18.425 ms [18.238 ms, 18.613 ms] | -986.152 µs (-5.1%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 19.621 ms [19.419 ms, 19.823 ms] | - |
| appsec | 18.678 ms [18.492 ms, 18.864 ms] | -942.715 µs (-4.8%) |
| code_origins | 18.116 ms [17.936 ms, 18.296 ms] | -1.505 ms (-7.7%) |
| iast | 18.49 ms [18.303 ms, 18.677 ms] | -1.131 ms (-5.8%) |
| profiling | 18.623 ms [18.435 ms, 18.811 ms] | -997.844 µs (-5.1%) |
| tracing | 18.733 ms [18.545 ms, 18.92 ms] | -888.395 µs (-4.5%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | mhlidd/additional_config_inversion_linters |
| git_commit_date | 1765312339 | 1764714156 |
| git_commit_sha | 6836076eba | f907aa74c8 |
| release_version | 1.57.0-SNAPSHOT~6836076eba | 1.57.0-SNAPSHOT~f907aa74c8 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1765316015 | 1765316015 |
| ci_job_id | 1281564890 | 1281564890 |
| ci_pipeline_id | 85753656 | 85753656 |
| cpu_model | Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-o51pttph 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-o51pttph 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~f907aa74c8, baseline=1.57.0-SNAPSHOT~6836076eba
dateFormat X
axisFormat %s
section baseline
no_agent (14.849 s) : 14849000, 14849000
. : milestone, 14849000,
appsec (14.58 s) : 14580000, 14580000
. : milestone, 14580000,
iast (17.577 s) : 17577000, 17577000
. : milestone, 17577000,
iast_GLOBAL (17.311 s) : 17311000, 17311000
. : milestone, 17311000,
profiling (13.852 s) : 13852000, 13852000
. : milestone, 13852000,
tracing (14.26 s) : 14260000, 14260000
. : milestone, 14260000,
section candidate
no_agent (15.321 s) : 15321000, 15321000
. : milestone, 15321000,
appsec (14.065 s) : 14065000, 14065000
. : milestone, 14065000,
iast (17.765 s) : 17765000, 17765000
. : milestone, 17765000,
iast_GLOBAL (17.466 s) : 17466000, 17466000
. : milestone, 17466000,
profiling (13.948 s) : 13948000, 13948000
. : milestone, 13948000,
tracing (14.476 s) : 14476000, 14476000
. : milestone, 14476000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 14.849 s [14.849 s, 14.849 s] | - |
| appsec | 14.58 s [14.58 s, 14.58 s] | -269.0 ms (-1.8%) |
| iast | 17.577 s [17.577 s, 17.577 s] | 2.728 s (18.4%) |
| iast_GLOBAL | 17.311 s [17.311 s, 17.311 s] | 2.462 s (16.6%) |
| profiling | 13.852 s [13.852 s, 13.852 s] | -997.0 ms (-6.7%) |
| tracing | 14.26 s [14.26 s, 14.26 s] | -589.0 ms (-4.0%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.321 s [15.321 s, 15.321 s] | - |
| appsec | 14.065 s [14.065 s, 14.065 s] | -1.256 s (-8.2%) |
| iast | 17.765 s [17.765 s, 17.765 s] | 2.444 s (16.0%) |
| iast_GLOBAL | 17.466 s [17.466 s, 17.466 s] | 2.145 s (14.0%) |
| profiling | 13.948 s [13.948 s, 13.948 s] | -1.373 s (-9.0%) |
| tracing | 14.476 s [14.476 s, 14.476 s] | -845.0 ms (-5.5%) |
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~f907aa74c8, baseline=1.57.0-SNAPSHOT~6836076eba
dateFormat X
axisFormat %s
section baseline
no_agent (1.494 ms) : 1482, 1506
. : milestone, 1494,
appsec (2.811 ms) : 2726, 2896
. : milestone, 2811,
iast (2.593 ms) : 2491, 2696
. : milestone, 2593,
iast_GLOBAL (2.64 ms) : 2538, 2743
. : milestone, 2640,
profiling (2.42 ms) : 2334, 2506
. : milestone, 2420,
tracing (2.39 ms) : 2307, 2474
. : milestone, 2390,
section candidate
no_agent (1.49 ms) : 1478, 1502
. : milestone, 1490,
appsec (2.805 ms) : 2720, 2890
. : milestone, 2805,
iast (2.594 ms) : 2491, 2696
. : milestone, 2594,
iast_GLOBAL (2.642 ms) : 2539, 2745
. : milestone, 2642,
profiling (2.424 ms) : 2337, 2511
. : milestone, 2424,
tracing (2.392 ms) : 2307, 2476
. : milestone, 2392,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.494 ms [1.482 ms, 1.506 ms] | - |
| appsec | 2.811 ms [2.726 ms, 2.896 ms] | 1.317 ms (88.1%) |
| iast | 2.593 ms [2.491 ms, 2.696 ms] | 1.099 ms (73.6%) |
| iast_GLOBAL | 2.64 ms [2.538 ms, 2.743 ms] | 1.146 ms (76.7%) |
| profiling | 2.42 ms [2.334 ms, 2.506 ms] | 925.658 µs (61.9%) |
| tracing | 2.39 ms [2.307 ms, 2.474 ms] | 896.252 µs (60.0%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.49 ms [1.478 ms, 1.502 ms] | - |
| appsec | 2.805 ms [2.72 ms, 2.89 ms] | 1.315 ms (88.2%) |
| iast | 2.594 ms [2.491 ms, 2.696 ms] | 1.103 ms (74.1%) |
| iast_GLOBAL | 2.642 ms [2.539 ms, 2.745 ms] | 1.152 ms (77.3%) |
| profiling | 2.424 ms [2.337 ms, 2.511 ms] | 934.214 µs (62.7%) |
| tracing | 2.392 ms [2.307 ms, 2.476 ms] | 901.854 µs (60.5%) |
![pr-commenter[bot] avatar](https://avatars.githubusercontent.com/u/365230?v=4 "Published by a pub.dev verified publisher"){kind=small}