Automatically register crashtracking via native extensions
What Does This Do
This PR
- reorganizes some of our Gradle dependencies to pull in
ddprof.jarjust the one time despite being used for multiple tracer features - enables crashtracking's automatic registration (if the dependent JVM flags have not been set by the customer via the command line)
Motivation
We would like to automatically enable crashtracking.
Additional Notes
The native library loading behavior & interactions via the tracer's Java code have been documented in our internal wiki, see "Loading of the ddprof Native Library in dd-trace-java". We could potentially include these docs in this PR for external contributors.
We see a mix of startup regression and unexpected 'improvements'. This seems to be caused by a change in the startup sequence. The crash-tracking enablement should not really cause a noticeable increase in the startup time - we are running the initialization in a background thread, unless overridden by a debug config flag. So, the only real regression would be the extra classes we load before we actually schedule the initialization.
If someone more knowledgeable of the benchmarks results interpretation can spot a valid regression, please, let me know so we can fix it.
Contributor Checklist
- Format the title according the contribution guidelines
- Assign the
type:and (comp:orinst:) labels in addition to any usefull labels - Don't use
close,fixor any linking keywords when referencing an issue.
Usesolvesinstead, and assign the PR milestone to the issue - Update the CODEOWNERS file on source file addition, move, or deletion
- Update the public documentation in case of new configuration flag or behavior
Jira ticket: PROF-11747 [PROF-10707] [PROF-11858]
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | mattalp/reroute-gradle-profiler-dependencies |
| git_commit_date | 1752596399 | 1752656392 |
| git_commit_sha | d9df78f4c9 | c05d54591b |
| release_version | 1.52.0-SNAPSHOT~d9df78f4c9 | 1.52.0-SNAPSHOT~c05d54591b |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1752658288 | 1752658288 |
| ci_job_id | 1030930420 | 1030930420 |
| ci_pipeline_id | 70686464 | 70686464 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-9t4wdoeo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-9t4wdoeo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 2 performance improvements and 11 performance regressions! Performance is the same for 29 metrics, 11 unstable metrics.
| scenario | Δ mean execution_time | candidate mean execution_time | baseline mean execution_time |
|---|---|---|---|
| scenario:startup:insecure-bank:iast:Agent.start | worse [+34.139ms; +78.422ms] or [+3.020%; +6.937%] |
1.187s | 1.131s |
| scenario:startup:insecure-bank:iast:BytebuddyAgent | worse [+38.456ms; +75.840ms] or [+4.784%; +9.434%] |
861.056ms | 803.908ms |
| scenario:startup:insecure-bank:tracing:Agent.start | worse [+33.893ms; +72.784ms] or [+3.395%; +7.292%] |
1051.532ms | 998.194ms |
| scenario:startup:insecure-bank:tracing:BytebuddyAgent | worse [+39.988ms; +67.099ms] or [+5.822%; +9.768%] |
740.440ms | 686.897ms |
| scenario:startup:petclinic:appsec:Agent.start | worse [+36.506ms; +44.197ms] or [+3.111%; +3.766%] |
1.214s | 1.173s |
| scenario:startup:petclinic:appsec:BytebuddyAgent | worse [+41.369ms; +46.463ms] or [+5.854%; +6.575%] |
750.561ms | 706.645ms |
| scenario:startup:petclinic:iast:Agent.start | worse [+40.806ms; +48.374ms] or [+3.618%; +4.290%] |
1.172s | 1.128s |
| scenario:startup:petclinic:iast:BytebuddyAgent | worse [+43.388ms; +48.757ms] or [+5.412%; +6.082%] |
847.719ms | 801.647ms |
| scenario:startup:petclinic:profiling:Agent.start | better [-93.276ms; -39.955ms] or [-7.393%; -3.167%] |
1.195s | 1.262s |
| scenario:startup:petclinic:profiling:BytebuddyAgent | worse [+65.543ms; +100.185ms] or [+9.560%; +14.613%] |
768.432ms | 685.568ms |
| scenario:startup:petclinic:profiling:GlobalTracer | better [-152.737ms; -142.533ms] or [-41.572%; -38.795%] |
219.768ms | 367.403ms |
| scenario:startup:petclinic:tracing:Agent.start | worse [+37.952ms; +44.378ms] or [+3.806%; +4.451%] |
1038.239ms | 997.074ms |
| scenario:startup:petclinic:tracing:BytebuddyAgent | worse [+41.346ms; +45.457ms] or [+6.019%; +6.618%] |
730.268ms | 686.866ms |
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~c05d54591b, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (998.194 ms) : 0, 998194
Total [baseline] (8.579 s) : 0, 8579329
Agent [candidate] (1.052 s) : 0, 1051532
Total [candidate] (8.632 s) : 0, 8632349
section iast
Agent [baseline] (1.131 s) : 0, 1130549
Total [baseline] (9.271 s) : 0, 9270705
Agent [candidate] (1.187 s) : 0, 1186829
Total [candidate] (9.35 s) : 0, 9350312
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 998.194 ms | - |
| Agent | iast | 1.131 s | 132.355 ms (13.3%) |
| Total | tracing | 8.579 s | - |
| Total | iast | 9.271 s | 691.376 ms (8.1%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.052 s | - |
| Agent | iast | 1.187 s | 135.297 ms (12.9%) |
| Total | tracing | 8.632 s | - |
| Total | iast | 9.35 s | 717.963 ms (8.3%) |
gantt
title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~c05d54591b, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section tracing
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (686.897 ms) : 0, 686897
BytebuddyAgent [candidate] (740.44 ms) : 0, 740440
GlobalTracer [baseline] (244.587 ms) : 0, 244587
GlobalTracer [candidate] (242.765 ms) : 0, 242765
AppSec [baseline] (30.901 ms) : 0, 30901
AppSec [candidate] (30.665 ms) : 0, 30665
Debugger [baseline] (6.052 ms) : 0, 6052
Debugger [candidate] (6.095 ms) : 0, 6095
Remote Config [baseline] (677.31 µs) : 0, 677
Remote Config [candidate] (663.4 µs) : 0, 663
Telemetry [baseline] (8.245 ms) : 0, 8245
Telemetry [candidate] (8.356 ms) : 0, 8356
section iast
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (803.908 ms) : 0, 803908
BytebuddyAgent [candidate] (861.056 ms) : 0, 861056
GlobalTracer [baseline] (233.361 ms) : 0, 233361
GlobalTracer [candidate] (231.248 ms) : 0, 231248
IAST [baseline] (26.423 ms) : 0, 26423
IAST [candidate] (30.628 ms) : 0, 30628
AppSec [baseline] (31.825 ms) : 0, 31825
AppSec [candidate] (26.276 ms) : 0, 26276
Debugger [baseline] (5.683 ms) : 0, 5683
Debugger [candidate] (6.59 ms) : 0, 6590
Remote Config [baseline] (582.081 µs) : 0, 582
Remote Config [candidate] (593.178 µs) : 0, 593
Telemetry [baseline] (7.885 ms) : 0, 7885
Telemetry [candidate] (7.935 ms) : 0, 7935
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~c05d54591b, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (997.074 ms) : 0, 997074
Total [baseline] (10.687 s) : 0, 10686552
Agent [candidate] (1.038 s) : 0, 1038239
Total [candidate] (10.686 s) : 0, 10685683
section appsec
Agent [baseline] (1.173 s) : 0, 1173440
Total [baseline] (10.718 s) : 0, 10718049
Agent [candidate] (1.214 s) : 0, 1213792
Total [candidate] (10.745 s) : 0, 10745108
section iast
Agent [baseline] (1.128 s) : 0, 1127705
Total [baseline] (10.819 s) : 0, 10819145
Agent [candidate] (1.172 s) : 0, 1172294
Total [candidate] (10.902 s) : 0, 10902304
section profiling
Agent [baseline] (1.262 s) : 0, 1261610
Total [baseline] (11.131 s) : 0, 11131399
Agent [candidate] (1.195 s) : 0, 1194995
Total [candidate] (10.896 s) : 0, 10896179
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 997.074 ms | - |
| Agent | appsec | 1.173 s | 176.367 ms (17.7%) |
| Agent | iast | 1.128 s | 130.631 ms (13.1%) |
| Agent | profiling | 1.262 s | 264.536 ms (26.5%) |
| Total | tracing | 10.687 s | - |
| Total | appsec | 10.718 s | 31.498 ms (0.3%) |
| Total | iast | 10.819 s | 132.593 ms (1.2%) |
| Total | profiling | 11.131 s | 444.848 ms (4.2%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.038 s | - |
| Agent | appsec | 1.214 s | 175.553 ms (16.9%) |
| Agent | iast | 1.172 s | 134.055 ms (12.9%) |
| Agent | profiling | 1.195 s | 156.755 ms (15.1%) |
| Total | tracing | 10.686 s | - |
| Total | appsec | 10.745 s | 59.425 ms (0.6%) |
| Total | iast | 10.902 s | 216.621 ms (2.0%) |
| Total | profiling | 10.896 s | 210.495 ms (2.0%) |
gantt
title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~c05d54591b, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section tracing
crashtracking [candidate] (1.439 ms) : 0, 1439
BytebuddyAgent [baseline] (686.866 ms) : 0, 686866
BytebuddyAgent [candidate] (730.268 ms) : 0, 730268
GlobalTracer [baseline] (243.655 ms) : 0, 243655
GlobalTracer [candidate] (239.605 ms) : 0, 239605
AppSec [baseline] (30.713 ms) : 0, 30713
AppSec [candidate] (30.279 ms) : 0, 30279
Debugger [baseline] (6.06 ms) : 0, 6060
Debugger [candidate] (6.011 ms) : 0, 6011
Remote Config [baseline] (680.538 µs) : 0, 681
Remote Config [candidate] (658.134 µs) : 0, 658
Telemetry [baseline] (8.207 ms) : 0, 8207
Telemetry [candidate] (8.98 ms) : 0, 8980
section appsec
crashtracking [candidate] (1.429 ms) : 0, 1429
BytebuddyAgent [baseline] (706.645 ms) : 0, 706645
BytebuddyAgent [candidate] (750.561 ms) : 0, 750561
GlobalTracer [baseline] (236.416 ms) : 0, 236416
GlobalTracer [candidate] (231.969 ms) : 0, 231969
IAST [baseline] (23.428 ms) : 0, 23428
IAST [candidate] (23.507 ms) : 0, 23507
AppSec [baseline] (171.78 ms) : 0, 171780
AppSec [candidate] (168.574 ms) : 0, 168574
Debugger [baseline] (5.733 ms) : 0, 5733
Debugger [candidate] (5.68 ms) : 0, 5680
Remote Config [baseline] (608.194 µs) : 0, 608
Remote Config [candidate] (619.772 µs) : 0, 620
Telemetry [baseline] (8.019 ms) : 0, 8019
Telemetry [candidate] (10.22 ms) : 0, 10220
section iast
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (801.647 ms) : 0, 801647
BytebuddyAgent [candidate] (847.719 ms) : 0, 847719
GlobalTracer [baseline] (233.465 ms) : 0, 233465
GlobalTracer [candidate] (229.772 ms) : 0, 229772
IAST [baseline] (25.312 ms) : 0, 25312
IAST [candidate] (27.592 ms) : 0, 27592
AppSec [baseline] (32.227 ms) : 0, 32227
AppSec [candidate] (29.482 ms) : 0, 29482
Debugger [baseline] (5.706 ms) : 0, 5706
Debugger [candidate] (6.629 ms) : 0, 6629
Remote Config [baseline] (565.04 µs) : 0, 565
Remote Config [candidate] (588.201 µs) : 0, 588
Telemetry [baseline] (7.903 ms) : 0, 7903
Telemetry [candidate] (8.048 ms) : 0, 8048
section profiling
crashtracking [candidate] (1.415 ms) : 0, 1415
BytebuddyAgent [baseline] (685.568 ms) : 0, 685568
BytebuddyAgent [candidate] (768.432 ms) : 0, 768432
GlobalTracer [baseline] (367.403 ms) : 0, 367403
GlobalTracer [candidate] (219.768 ms) : 0, 219768
AppSec [baseline] (32.406 ms) : 0, 32406
AppSec [candidate] (30.611 ms) : 0, 30611
Debugger [baseline] (12.217 ms) : 0, 12217
Debugger [candidate] (6.354 ms) : 0, 6354
Remote Config [baseline] (663.888 µs) : 0, 664
Remote Config [candidate] (683.719 µs) : 0, 684
Telemetry [baseline] (8.927 ms) : 0, 8927
Telemetry [candidate] (12.659 ms) : 0, 12659
ProfilingAgent [baseline] (105.136 ms) : 0, 105136
ProfilingAgent [candidate] (106.018 ms) : 0, 106018
Profiling [baseline] (105.161 ms) : 0, 105161
Profiling [candidate] (106.041 ms) : 0, 106041
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | mattalp/reroute-gradle-profiler-dependencies |
| git_commit_date | 1752596399 | 1752656392 |
| git_commit_sha | d9df78f4c9 | c05d54591b |
| release_version | 1.52.0-SNAPSHOT~d9df78f4c9 | 1.52.0-SNAPSHOT~c05d54591b |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1752657956 | 1752657956 |
| ci_job_id | 1030930421 | 1030930421 |
| ci_pipeline_id | 70686464 | 70686464 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-1-pvg0uc4z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-1-pvg0uc4z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 2 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.
| scenario | Δ mean http_req_duration | Δ mean throughput | candidate mean http_req_duration | candidate mean throughput | baseline mean http_req_duration | baseline mean throughput |
|---|---|---|---|---|---|---|
| scenario:load:petclinic:iast:high_load | worse [+0.996ms; +1.812ms] or [+2.281%; +4.152%] |
unstable [-10.276op/s; +3.576op/s] or [-9.585%; +3.335%] |
45.040ms | 103.862op/s | 43.636ms | 107.213op/s |
| scenario:load:petclinic:profiling:high_load | worse [+3.276ms; +4.234ms] or [+7.011%; +9.060%] |
unstable [-14.026op/s; -0.799op/s] or [-14.011%; -0.798%] |
50.485ms | 92.700op/s | 46.730ms | 100.112op/s |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~c05d54591b, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section baseline
no_agent (37.542 ms) : 37240, 37844
. : milestone, 37542,
appsec (46.236 ms) : 45813, 46660
. : milestone, 46236,
code_origins (44.481 ms) : 44094, 44868
. : milestone, 44481,
iast (43.636 ms) : 43263, 44010
. : milestone, 43636,
profiling (46.73 ms) : 46315, 47146
. : milestone, 46730,
tracing (45.166 ms) : 44786, 45545
. : milestone, 45166,
section candidate
no_agent (36.887 ms) : 36600, 37174
. : milestone, 36887,
appsec (46.017 ms) : 45606, 46429
. : milestone, 46017,
code_origins (44.758 ms) : 44375, 45142
. : milestone, 44758,
iast (45.04 ms) : 44655, 45425
. : milestone, 45040,
profiling (50.485 ms) : 50014, 50957
. : milestone, 50485,
tracing (44.38 ms) : 43991, 44769
. : milestone, 44380,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 37.542 ms [37.24 ms, 37.844 ms] | - |
| appsec | 46.236 ms [45.813 ms, 46.66 ms] | 8.694 ms (23.2%) |
| code_origins | 44.481 ms [44.094 ms, 44.868 ms] | 6.939 ms (18.5%) |
| iast | 43.636 ms [43.263 ms, 44.01 ms] | 6.094 ms (16.2%) |
| profiling | 46.73 ms [46.315 ms, 47.146 ms] | 9.188 ms (24.5%) |
| tracing | 45.166 ms [44.786 ms, 45.545 ms] | 7.623 ms (20.3%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 36.887 ms [36.6 ms, 37.174 ms] | - |
| appsec | 46.017 ms [45.606 ms, 46.429 ms] | 9.13 ms (24.8%) |
| code_origins | 44.758 ms [44.375 ms, 45.142 ms] | 7.871 ms (21.3%) |
| iast | 45.04 ms [44.655 ms, 45.425 ms] | 8.153 ms (22.1%) |
| profiling | 50.485 ms [50.014 ms, 50.957 ms] | 13.598 ms (36.9%) |
| tracing | 44.38 ms [43.991 ms, 44.769 ms] | 7.493 ms (20.3%) |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~c05d54591b, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section baseline
no_agent (4.387 ms) : 4335, 4439
. : milestone, 4387,
iast (9.537 ms) : 9373, 9700
. : milestone, 9537,
iast_FULL (14.015 ms) : 13735, 14294
. : milestone, 14015,
iast_GLOBAL (10.727 ms) : 10535, 10918
. : milestone, 10727,
profiling (8.751 ms) : 8607, 8895
. : milestone, 8751,
tracing (7.614 ms) : 7509, 7720
. : milestone, 7614,
section candidate
no_agent (4.287 ms) : 4238, 4337
. : milestone, 4287,
iast (9.356 ms) : 9205, 9507
. : milestone, 9356,
iast_FULL (14.283 ms) : 13995, 14570
. : milestone, 14283,
iast_GLOBAL (10.37 ms) : 10189, 10550
. : milestone, 10370,
profiling (8.957 ms) : 8807, 9108
. : milestone, 8957,
tracing (7.754 ms) : 7646, 7862
. : milestone, 7754,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 4.387 ms [4.335 ms, 4.439 ms] | - |
| iast | 9.537 ms [9.373 ms, 9.7 ms] | 5.15 ms (117.4%) |
| iast_FULL | 14.015 ms [13.735 ms, 14.294 ms] | 9.628 ms (219.5%) |
| iast_GLOBAL | 10.727 ms [10.535 ms, 10.918 ms] | 6.34 ms (144.5%) |
| profiling | 8.751 ms [8.607 ms, 8.895 ms] | 4.364 ms (99.5%) |
| tracing | 7.614 ms [7.509 ms, 7.72 ms] | 3.228 ms (73.6%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 4.287 ms [4.238 ms, 4.337 ms] | - |
| iast | 9.356 ms [9.205 ms, 9.507 ms] | 5.069 ms (118.2%) |
| iast_FULL | 14.283 ms [13.995 ms, 14.57 ms] | 9.995 ms (233.1%) |
| iast_GLOBAL | 10.37 ms [10.189 ms, 10.55 ms] | 6.082 ms (141.9%) |
| profiling | 8.957 ms [8.807 ms, 9.108 ms] | 4.67 ms (108.9%) |
| tracing | 7.754 ms [7.646 ms, 7.862 ms] | 3.467 ms (80.9%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | mattalp/reroute-gradle-profiler-dependencies |
| git_commit_date | 1752596399 | 1752656392 |
| git_commit_sha | d9df78f4c9 | c05d54591b |
| release_version | 1.52.0-SNAPSHOT~d9df78f4c9 | 1.52.0-SNAPSHOT~c05d54591b |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1752658432 | 1752658432 |
| ci_job_id | 1030930422 | 1030930422 |
| ci_pipeline_id | 70686464 | 70686464 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-2-n4hseobz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-2-n4hseobz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~c05d54591b, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1496
. : milestone, 1485,
appsec (2.427 ms) : 2376, 2477
. : milestone, 2427,
iast (2.203 ms) : 2140, 2265
. : milestone, 2203,
iast_GLOBAL (2.253 ms) : 2190, 2316
. : milestone, 2253,
profiling (2.054 ms) : 2004, 2104
. : milestone, 2054,
tracing (2.015 ms) : 1966, 2063
. : milestone, 2015,
section candidate
no_agent (1.479 ms) : 1467, 1490
. : milestone, 1479,
appsec (3.63 ms) : 3416, 3843
. : milestone, 3630,
iast (2.201 ms) : 2138, 2263
. : milestone, 2201,
iast_GLOBAL (2.248 ms) : 2185, 2311
. : milestone, 2248,
profiling (2.044 ms) : 1994, 2094
. : milestone, 2044,
tracing (2.026 ms) : 1977, 2075
. : milestone, 2026,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.485 ms [1.473 ms, 1.496 ms] | - |
| appsec | 2.427 ms [2.376 ms, 2.477 ms] | 941.875 µs (63.4%) |
| iast | 2.203 ms [2.14 ms, 2.265 ms] | 717.932 µs (48.4%) |
| iast_GLOBAL | 2.253 ms [2.19 ms, 2.316 ms] | 768.307 µs (51.7%) |
| profiling | 2.054 ms [2.004 ms, 2.104 ms] | 569.12 µs (38.3%) |
| tracing | 2.015 ms [1.966 ms, 2.063 ms] | 529.958 µs (35.7%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.479 ms [1.467 ms, 1.49 ms] | - |
| appsec | 3.63 ms [3.416 ms, 3.843 ms] | 2.151 ms (145.5%) |
| iast | 2.201 ms [2.138 ms, 2.263 ms] | 722.102 µs (48.8%) |
| iast_GLOBAL | 2.248 ms [2.185 ms, 2.311 ms] | 769.144 µs (52.0%) |
| profiling | 2.044 ms [1.994 ms, 2.094 ms] | 564.981 µs (38.2%) |
| tracing | 2.026 ms [1.977 ms, 2.075 ms] | 547.203 µs (37.0%) |
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~c05d54591b, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section baseline
no_agent (14.837 s) : 14837000, 14837000
. : milestone, 14837000,
appsec (15.013 s) : 15013000, 15013000
. : milestone, 15013000,
iast (18.863 s) : 18863000, 18863000
. : milestone, 18863000,
iast_GLOBAL (18.038 s) : 18038000, 18038000
. : milestone, 18038000,
profiling (15.182 s) : 15182000, 15182000
. : milestone, 15182000,
tracing (14.8 s) : 14800000, 14800000
. : milestone, 14800000,
section candidate
no_agent (15.549 s) : 15549000, 15549000
. : milestone, 15549000,
appsec (14.964 s) : 14964000, 14964000
. : milestone, 14964000,
iast (18.327 s) : 18327000, 18327000
. : milestone, 18327000,
iast_GLOBAL (18.181 s) : 18181000, 18181000
. : milestone, 18181000,
profiling (15.351 s) : 15351000, 15351000
. : milestone, 15351000,
tracing (15.074 s) : 15074000, 15074000
. : milestone, 15074000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 14.837 s [14.837 s, 14.837 s] | - |
| appsec | 15.013 s [15.013 s, 15.013 s] | 176.0 ms (1.2%) |
| iast | 18.863 s [18.863 s, 18.863 s] | 4.026 s (27.1%) |
| iast_GLOBAL | 18.038 s [18.038 s, 18.038 s] | 3.201 s (21.6%) |
| profiling | 15.182 s [15.182 s, 15.182 s] | 345.0 ms (2.3%) |
| tracing | 14.8 s [14.8 s, 14.8 s] | -37.0 ms (-0.2%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 15.549 s [15.549 s, 15.549 s] | - |
| appsec | 14.964 s [14.964 s, 14.964 s] | -585.0 ms (-3.8%) |
| iast | 18.327 s [18.327 s, 18.327 s] | 2.778 s (17.9%) |
| iast_GLOBAL | 18.181 s [18.181 s, 18.181 s] | 2.632 s (16.9%) |
| profiling | 15.351 s [15.351 s, 15.351 s] | -198.0 ms (-1.3%) |
| tracing | 15.074 s [15.074 s, 15.074 s] | -475.0 ms (-3.1%) |
Adding @PerfectSlayer as a reviewer, as this touches on code he's currently working on
@bric3
nitpick: Might be worth putting this comment as comment in the code ;)
What exactly do you mean?