dd-trace-java
dd-trace-java copied to clipboard
DataDog
Rewrite test-suites in kotlin
What Does This Do
This PR creates a new file test-suites.gradle.kts, written in Kotlin. However, this Kotlin file cannot be easily used yet because it needs to replace the original test-suites.gradle file. BUT, this file is called from the broader Groovy https://github.com/DataDog/dd-trace-java/blob/master/gradle/java_no_deps.gradle#L15 file, where the apply from: mechanism only works for other Groovy files. Thus, we would need to convert all of these transitively dependent build files to Kotlin first, which is a massive undertaking...
Motivation
Additional Notes
Contributor Checklist
- Format the title according the contribution guidelines
- Assign the
type:and (comp:orinst:) labels in addition to any usefull labels - Don't use
close,fixor any linking keywords when referencing an issue.
Usesolvesinstead, and assign the PR milestone to the issue - Update the CODEOWNERS file on source file addition, move, or deletion
- Update the public documentation in case of new configuration flag or behavior
Jira ticket: [PROJ-IDENT]
🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.77% (-0.06%)
View detailed report
🔗 Commit SHA: 4081713 | Docs | Was this helpful? Give us feedback!
![datadog-datadog-prod-us1[bot] avatar](https://avatars.githubusercontent.com/u/365230?v=4 "Published by a pub.dev verified publisher"){kind=small}
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | sarahchen6/rewrite-test-suites-in-kotlin |
| git_commit_date | 1758570639 | 1758570099 |
| git_commit_sha | b91074c79a | 4081713026 |
| release_version | 1.54.0-SNAPSHOT~b91074c79a | 1.54.0-SNAPSHOT~4081713026 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1758572725 | 1758572725 |
| ci_job_id | 1141980745 | 1141980745 |
| ci_pipeline_id | 77217641 | 77217641 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-rgbqr861 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-rgbqr861 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 10 unstable metrics.
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.022 s) : 0, 1021678
Total [baseline] (8.683 s) : 0, 8682764
Agent [candidate] (1.019 s) : 0, 1018529
Total [candidate] (8.649 s) : 0, 8649166
section iast
Agent [baseline] (1.156 s) : 0, 1156379
Total [baseline] (9.317 s) : 0, 9317443
Agent [candidate] (1.161 s) : 0, 1160707
Total [candidate] (9.404 s) : 0, 9403986
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.022 s | - |
| Agent | iast | 1.156 s | 134.701 ms (13.2%) |
| Total | tracing | 8.683 s | - |
| Total | iast | 9.317 s | 634.679 ms (7.3%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.019 s | - |
| Agent | iast | 1.161 s | 142.178 ms (14.0%) |
| Total | tracing | 8.649 s | - |
| Total | iast | 9.404 s | 754.82 ms (8.7%) |
gantt
title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (689.748 ms) : 0, 689748
BytebuddyAgent [candidate] (687.36 ms) : 0, 687360
GlobalTracer [baseline] (257.929 ms) : 0, 257929
GlobalTracer [candidate] (258.299 ms) : 0, 258299
AppSec [baseline] (31.707 ms) : 0, 31707
AppSec [candidate] (31.633 ms) : 0, 31633
Debugger [baseline] (6.34 ms) : 0, 6340
Debugger [candidate] (6.359 ms) : 0, 6359
Remote Config [baseline] (685.842 µs) : 0, 686
Remote Config [candidate] (678.825 µs) : 0, 679
Telemetry [baseline] (12.829 ms) : 0, 12829
Telemetry [candidate] (11.772 ms) : 0, 11772
section iast
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (811.592 ms) : 0, 811592
BytebuddyAgent [candidate] (813.355 ms) : 0, 813355
GlobalTracer [baseline] (248.281 ms) : 0, 248281
GlobalTracer [candidate] (250.604 ms) : 0, 250604
AppSec [baseline] (29.091 ms) : 0, 29091
AppSec [candidate] (26.619 ms) : 0, 26619
Debugger [baseline] (6.136 ms) : 0, 6136
Debugger [candidate] (6.137 ms) : 0, 6137
Remote Config [baseline] (598.359 µs) : 0, 598
Remote Config [candidate] (599.73 µs) : 0, 600
Telemetry [baseline] (8.203 ms) : 0, 8203
Telemetry [candidate] (8.096 ms) : 0, 8096
IAST [baseline] (30.079 ms) : 0, 30079
IAST [candidate] (32.769 ms) : 0, 32769
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.028 s) : 0, 1027548
Total [baseline] (10.723 s) : 0, 10723242
Agent [candidate] (1.026 s) : 0, 1025724
Total [candidate] (10.691 s) : 0, 10691169
section appsec
Agent [baseline] (1.203 s) : 0, 1203144
Total [baseline] (10.96 s) : 0, 10960310
Agent [candidate] (1.196 s) : 0, 1195531
Total [candidate] (10.976 s) : 0, 10976263
section iast
Agent [baseline] (1.154 s) : 0, 1153810
Total [baseline] (11.033 s) : 0, 11033013
Agent [candidate] (1.161 s) : 0, 1160892
Total [candidate] (11.116 s) : 0, 11115566
section profiling
Agent [baseline] (1.171 s) : 0, 1171124
Total [baseline] (11.031 s) : 0, 11030574
Agent [candidate] (1.165 s) : 0, 1164966
Total [candidate] (11.063 s) : 0, 11062806
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.028 s | - |
| Agent | appsec | 1.203 s | 175.596 ms (17.1%) |
| Agent | iast | 1.154 s | 126.262 ms (12.3%) |
| Agent | profiling | 1.171 s | 143.576 ms (14.0%) |
| Total | tracing | 10.723 s | - |
| Total | appsec | 10.96 s | 237.068 ms (2.2%) |
| Total | iast | 11.033 s | 309.771 ms (2.9%) |
| Total | profiling | 11.031 s | 307.331 ms (2.9%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.026 s | - |
| Agent | appsec | 1.196 s | 169.807 ms (16.6%) |
| Agent | iast | 1.161 s | 135.168 ms (13.2%) |
| Agent | profiling | 1.165 s | 139.242 ms (13.6%) |
| Total | tracing | 10.691 s | - |
| Total | appsec | 10.976 s | 285.094 ms (2.7%) |
| Total | iast | 11.116 s | 424.396 ms (4.0%) |
| Total | profiling | 11.063 s | 371.636 ms (3.5%) |
gantt
title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (692.353 ms) : 0, 692353
BytebuddyAgent [candidate] (691.537 ms) : 0, 691537
GlobalTracer [baseline] (259.258 ms) : 0, 259258
GlobalTracer [candidate] (259.895 ms) : 0, 259895
AppSec [baseline] (32.002 ms) : 0, 32002
AppSec [candidate] (32.069 ms) : 0, 32069
Debugger [baseline] (6.41 ms) : 0, 6410
Debugger [candidate] (6.381 ms) : 0, 6381
Remote Config [baseline] (685.225 µs) : 0, 685
Remote Config [candidate] (679.441 µs) : 0, 679
Telemetry [baseline] (14.229 ms) : 0, 14229
Telemetry [candidate] (12.563 ms) : 0, 12563
section appsec
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (715.727 ms) : 0, 715727
BytebuddyAgent [candidate] (710.15 ms) : 0, 710150
GlobalTracer [baseline] (251.164 ms) : 0, 251164
GlobalTracer [candidate] (250.973 ms) : 0, 250973
AppSec [baseline] (172.485 ms) : 0, 172485
AppSec [candidate] (170.236 ms) : 0, 170236
Debugger [baseline] (6.091 ms) : 0, 6091
Debugger [candidate] (5.989 ms) : 0, 5989
Remote Config [baseline] (620.981 µs) : 0, 621
Remote Config [candidate] (602.972 µs) : 0, 603
Telemetry [baseline] (9.253 ms) : 0, 9253
Telemetry [candidate] (9.987 ms) : 0, 9987
IAST [baseline] (25.17 ms) : 0, 25170
IAST [candidate] (25.09 ms) : 0, 25090
section iast
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (809.015 ms) : 0, 809015
BytebuddyAgent [candidate] (813.584 ms) : 0, 813584
GlobalTracer [baseline] (248.194 ms) : 0, 248194
GlobalTracer [candidate] (250.809 ms) : 0, 250809
AppSec [baseline] (29.111 ms) : 0, 29111
AppSec [candidate] (27.265 ms) : 0, 27265
Debugger [baseline] (6.152 ms) : 0, 6152
Debugger [candidate] (6.178 ms) : 0, 6178
Remote Config [baseline] (602.294 µs) : 0, 602
Remote Config [candidate] (626.834 µs) : 0, 627
Telemetry [baseline] (8.277 ms) : 0, 8277
Telemetry [candidate] (8.142 ms) : 0, 8142
IAST [baseline] (30.04 ms) : 0, 30040
IAST [candidate] (31.798 ms) : 0, 31798
section profiling
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (724.79 ms) : 0, 724790
BytebuddyAgent [candidate] (720.031 ms) : 0, 720031
GlobalTracer [baseline] (236.433 ms) : 0, 236433
GlobalTracer [candidate] (236.285 ms) : 0, 236285
AppSec [baseline] (31.386 ms) : 0, 31386
AppSec [candidate] (30.99 ms) : 0, 30990
Debugger [baseline] (6.518 ms) : 0, 6518
Debugger [candidate] (6.479 ms) : 0, 6479
Remote Config [baseline] (721.726 µs) : 0, 722
Remote Config [candidate] (696.656 µs) : 0, 697
Telemetry [baseline] (16.522 ms) : 0, 16522
Telemetry [candidate] (15.756 ms) : 0, 15756
ProfilingAgent [baseline] (101.8 ms) : 0, 101800
ProfilingAgent [candidate] (101.36 ms) : 0, 101360
Profiling [baseline] (102.391 ms) : 0, 102391
Profiling [candidate] (101.959 ms) : 0, 101959
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | sarahchen6/rewrite-test-suites-in-kotlin |
| git_commit_date | 1758570639 | 1758570099 |
| git_commit_sha | b91074c79a | 4081713026 |
| release_version | 1.54.0-SNAPSHOT~b91074c79a | 1.54.0-SNAPSHOT~4081713026 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1758572354 | 1758572354 |
| ci_job_id | 1141980746 | 1141980746 |
| ci_pipeline_id | 77217641 | 77217641 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-8o13bfxu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-8o13bfxu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 2 performance improvements and 5 performance regressions! Performance is the same for 5 metrics, 12 unstable metrics.
| scenario | Δ mean http_req_duration | Δ mean throughput | candidate mean http_req_duration | candidate mean throughput | baseline mean http_req_duration | baseline mean throughput |
|---|---|---|---|---|---|---|
| scenario:load:insecure-bank:tracing:high_load | worse [+321.490µs; +561.275µs] or [+4.285%; +7.481%] |
unstable [-107.526op/s; +40.026op/s] or [-17.428%; +6.488%] |
7.945ms | 583.219op/s | 7.503ms | 616.969op/s |
| scenario:load:insecure-bank:profiling:high_load | better [-680.527µs; -335.985µs] or [-7.015%; -3.463%] |
unstable [-36.136op/s; +86.386op/s] or [-7.533%; +18.008%] |
9.193ms | 504.844op/s | 9.701ms | 479.719op/s |
| scenario:load:insecure-bank:iast_FULL:high_load | better [-1101.736µs; -480.898µs] or [-7.489%; -3.269%] |
unstable [-17.163op/s; +52.975op/s] or [-5.418%; +16.723%] |
13.919ms | 334.688op/s | 14.711ms | 316.781op/s |
| scenario:load:insecure-bank:iast:high_load | worse [+216.868µs; +551.125µs] or [+2.348%; +5.967%] |
unstable [-74.923op/s; +35.548op/s] or [-14.913%; +7.076%] |
9.620ms | 482.719op/s | 9.236ms | 502.406op/s |
| scenario:load:petclinic:iast:high_load | worse [+1.277ms; +2.111ms] or [+2.914%; +4.815%] |
unstable [-11.346op/s; +3.371op/s] or [-10.630%; +3.158%] |
45.528ms | 102.750op/s | 43.834ms | 106.737op/s |
| scenario:load:petclinic:code_origins:high_load | worse [+1.609ms; +2.426ms] or [+3.747%; +5.652%] |
unstable [-12.275op/s; +2.625op/s] or [-11.267%; +2.410%] |
44.942ms | 104.125op/s | 42.925ms | 108.950op/s |
| scenario:load:petclinic:profiling:high_load | worse [+2.520ms; +3.513ms] or [+5.361%; +7.475%] |
unstable [-11.656op/s; +1.975op/s] or [-11.706%; +1.983%] |
50.022ms | 94.734op/s | 47.005ms | 99.575op/s |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
dateFormat X
axisFormat %s
section baseline
no_agent (4.426 ms) : 4369, 4483
. : milestone, 4426,
iast (9.236 ms) : 9085, 9386
. : milestone, 9236,
iast_FULL (14.711 ms) : 14410, 15011
. : milestone, 14711,
iast_GLOBAL (10.537 ms) : 10346, 10728
. : milestone, 10537,
profiling (9.701 ms) : 9533, 9869
. : milestone, 9701,
tracing (7.503 ms) : 7401, 7605
. : milestone, 7503,
section candidate
no_agent (4.543 ms) : 4484, 4602
. : milestone, 4543,
iast (9.62 ms) : 9460, 9780
. : milestone, 9620,
iast_FULL (13.919 ms) : 13643, 14195
. : milestone, 13919,
iast_GLOBAL (10.572 ms) : 10386, 10757
. : milestone, 10572,
profiling (9.193 ms) : 9041, 9345
. : milestone, 9193,
tracing (7.945 ms) : 7825, 8065
. : milestone, 7945,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 4.426 ms [4.369 ms, 4.483 ms] | - |
| iast | 9.236 ms [9.085 ms, 9.386 ms] | 4.81 ms (108.7%) |
| iast_FULL | 14.711 ms [14.41 ms, 15.011 ms] | 10.285 ms (232.4%) |
| iast_GLOBAL | 10.537 ms [10.346 ms, 10.728 ms] | 6.112 ms (138.1%) |
| profiling | 9.701 ms [9.533 ms, 9.869 ms] | 5.276 ms (119.2%) |
| tracing | 7.503 ms [7.401 ms, 7.605 ms] | 3.077 ms (69.5%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 4.543 ms [4.484 ms, 4.602 ms] | - |
| iast | 9.62 ms [9.46 ms, 9.78 ms] | 5.077 ms (111.7%) |
| iast_FULL | 13.919 ms [13.643 ms, 14.195 ms] | 9.376 ms (206.4%) |
| iast_GLOBAL | 10.572 ms [10.386 ms, 10.757 ms] | 6.028 ms (132.7%) |
| profiling | 9.193 ms [9.041 ms, 9.345 ms] | 4.65 ms (102.4%) |
| tracing | 7.945 ms [7.825 ms, 8.065 ms] | 3.401 ms (74.9%) |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
dateFormat X
axisFormat %s
section baseline
no_agent (36.293 ms) : 36001, 36584
. : milestone, 36293,
appsec (47.981 ms) : 47548, 48415
. : milestone, 47981,
code_origins (42.925 ms) : 42550, 43299
. : milestone, 42925,
iast (43.834 ms) : 43465, 44204
. : milestone, 43834,
profiling (47.005 ms) : 46559, 47452
. : milestone, 47005,
tracing (43.218 ms) : 42854, 43582
. : milestone, 43218,
section candidate
no_agent (35.945 ms) : 35665, 36225
. : milestone, 35945,
appsec (47.631 ms) : 47196, 48065
. : milestone, 47631,
code_origins (44.942 ms) : 44557, 45327
. : milestone, 44942,
iast (45.528 ms) : 45124, 45933
. : milestone, 45528,
profiling (50.022 ms) : 49546, 50498
. : milestone, 50022,
tracing (43.865 ms) : 43493, 44237
. : milestone, 43865,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 36.293 ms [36.001 ms, 36.584 ms] | - |
| appsec | 47.981 ms [47.548 ms, 48.415 ms] | 11.689 ms (32.2%) |
| code_origins | 42.925 ms [42.55 ms, 43.299 ms] | 6.632 ms (18.3%) |
| iast | 43.834 ms [43.465 ms, 44.204 ms] | 7.542 ms (20.8%) |
| profiling | 47.005 ms [46.559 ms, 47.452 ms] | 10.713 ms (29.5%) |
| tracing | 43.218 ms [42.854 ms, 43.582 ms] | 6.925 ms (19.1%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 35.945 ms [35.665 ms, 36.225 ms] | - |
| appsec | 47.631 ms [47.196 ms, 48.065 ms] | 11.686 ms (32.5%) |
| code_origins | 44.942 ms [44.557 ms, 45.327 ms] | 8.997 ms (25.0%) |
| iast | 45.528 ms [45.124 ms, 45.933 ms] | 9.583 ms (26.7%) |
| profiling | 50.022 ms [49.546 ms, 50.498 ms] | 14.077 ms (39.2%) |
| tracing | 43.865 ms [43.493 ms, 44.237 ms] | 7.92 ms (22.0%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | sarahchen6/rewrite-test-suites-in-kotlin |
| git_commit_date | 1758570639 | 1758570099 |
| git_commit_sha | b91074c79a | 4081713026 |
| release_version | 1.54.0-SNAPSHOT~b91074c79a | 1.54.0-SNAPSHOT~4081713026 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1758572731 | 1758572731 |
| ci_job_id | 1141980747 | 1141980747 |
| ci_pipeline_id | 77217641 | 77217641 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-exfu601u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-exfu601u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.
| scenario | Δ mean execution_time | candidate mean execution_time | baseline mean execution_time |
|---|---|---|---|
| scenario:dacapo:tomcat:appsec | better [-1.433ms; -1.091ms] or [-38.656%; -29.448%] |
2.444ms | 3.706ms |
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
dateFormat X
axisFormat %s
section baseline
no_agent (15.495 s) : 15495000, 15495000
. : milestone, 15495000,
appsec (15.071 s) : 15071000, 15071000
. : milestone, 15071000,
iast (18.588 s) : 18588000, 18588000
. : milestone, 18588000,
iast_GLOBAL (18.479 s) : 18479000, 18479000
. : milestone, 18479000,
profiling (15.859 s) : 15859000, 15859000
. : milestone, 15859000,
tracing (14.854 s) : 14854000, 14854000
. : milestone, 14854000,
section candidate
no_agent (14.802 s) : 14802000, 14802000
. : milestone, 14802000,
appsec (14.945 s) : 14945000, 14945000
. : milestone, 14945000,
iast (18.356 s) : 18356000, 18356000
. : milestone, 18356000,
iast_GLOBAL (18.314 s) : 18314000, 18314000
. : milestone, 18314000,
profiling (15.982 s) : 15982000, 15982000
. : milestone, 15982000,
tracing (15.21 s) : 15210000, 15210000
. : milestone, 15210000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.495 s [15.495 s, 15.495 s] | - |
| appsec | 15.071 s [15.071 s, 15.071 s] | -424.0 ms (-2.7%) |
| iast | 18.588 s [18.588 s, 18.588 s] | 3.093 s (20.0%) |
| iast_GLOBAL | 18.479 s [18.479 s, 18.479 s] | 2.984 s (19.3%) |
| profiling | 15.859 s [15.859 s, 15.859 s] | 364.0 ms (2.3%) |
| tracing | 14.854 s [14.854 s, 14.854 s] | -641.0 ms (-4.1%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 14.802 s [14.802 s, 14.802 s] | - |
| appsec | 14.945 s [14.945 s, 14.945 s] | 143.0 ms (1.0%) |
| iast | 18.356 s [18.356 s, 18.356 s] | 3.554 s (24.0%) |
| iast_GLOBAL | 18.314 s [18.314 s, 18.314 s] | 3.512 s (23.7%) |
| profiling | 15.982 s [15.982 s, 15.982 s] | 1.18 s (8.0%) |
| tracing | 15.21 s [15.21 s, 15.21 s] | 408.0 ms (2.8%) |
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~4081713026, baseline=1.54.0-SNAPSHOT~b91074c79a
dateFormat X
axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
. : milestone, 1474,
appsec (3.706 ms) : 3487, 3924
. : milestone, 3706,
iast (2.201 ms) : 2138, 2264
. : milestone, 2201,
iast_GLOBAL (2.236 ms) : 2173, 2299
. : milestone, 2236,
profiling (2.048 ms) : 1997, 2099
. : milestone, 2048,
tracing (2.032 ms) : 1983, 2081
. : milestone, 2032,
section candidate
no_agent (1.473 ms) : 1461, 1484
. : milestone, 1473,
appsec (2.444 ms) : 2394, 2494
. : milestone, 2444,
iast (2.197 ms) : 2135, 2259
. : milestone, 2197,
iast_GLOBAL (2.236 ms) : 2173, 2299
. : milestone, 2236,
profiling (2.059 ms) : 2008, 2109
. : milestone, 2059,
tracing (2.023 ms) : 1974, 2072
. : milestone, 2023,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.474 ms [1.462 ms, 1.485 ms] | - |
| appsec | 3.706 ms [3.487 ms, 3.924 ms] | 2.232 ms (151.5%) |
| iast | 2.201 ms [2.138 ms, 2.264 ms] | 726.978 µs (49.3%) |
| iast_GLOBAL | 2.236 ms [2.173 ms, 2.299 ms] | 761.869 µs (51.7%) |
| profiling | 2.048 ms [1.997 ms, 2.099 ms] | 574.373 µs (39.0%) |
| tracing | 2.032 ms [1.983 ms, 2.081 ms] | 558.242 µs (37.9%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.473 ms [1.461 ms, 1.484 ms] | - |
| appsec | 2.444 ms [2.394 ms, 2.494 ms] | 971.155 µs (65.9%) |
| iast | 2.197 ms [2.135 ms, 2.259 ms] | 724.104 µs (49.2%) |
| iast_GLOBAL | 2.236 ms [2.173 ms, 2.299 ms] | 763.178 µs (51.8%) |
| profiling | 2.059 ms [2.008 ms, 2.109 ms] | 585.953 µs (39.8%) |
| tracing | 2.023 ms [1.974 ms, 2.072 ms] | 549.857 µs (37.3%) |