Using ddprof nightly snapshot for nightly test
What Does This Do
Allows dd-trace-java's nightly test to use java-profiler's latest snapshot.
Motivation
Up to now, dd-trace-java always uses latest release version of java-profiler for testing, that means java-profiler does not get any integration tests until it has been released.
With the PR, java-profiler gets early exposure to dd-trace-java's nightly test, should help to catch any integration problems and improve test coverage.
Additional Notes
Contributor Checklist
- Format the title according the contribution guidelines
- Assign the
type:and (comp:orinst:) labels in addition to any useful labels - Don't use
close,fixor any linking keywords when referencing an issue.
Usesolvesinstead, and assign the PR milestone to the issue - Update the CODEOWNERS file on source file addition, move, or deletion
- Update the public documentation in case of new configuration flag or behavior
Jira ticket: [PROJ-IDENT]
🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.60% (-0.04%)
View detailed report
🔗 Commit SHA: cb69d71 | Docs | Datadog PR Page | Was this helpful? Give us feedback!
Benchmarks
Startup
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | zgu/profiler_nightly_test |
| git_commit_date | 1762533227 | 1762534631 |
| git_commit_sha | 54da873ecc | cb69d71194 |
| release_version | 1.56.0-SNAPSHOT~54da873ecc | 1.56.0-SNAPSHOT~cb69d71194 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1762536825 | 1762536825 |
| ci_job_id | 1222847156 | 1222847156 |
| ci_pipeline_id | 81621344 | 81621344 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-jipb4pyw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-jipb4pyw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| module | Agent | Agent |
| parent | None | None |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 12 unstable metrics.
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051067
Total [baseline] (10.866 s) : 0, 10865905
Agent [candidate] (1.055 s) : 0, 1055344
Total [candidate] (10.682 s) : 0, 10682092
section appsec
Agent [baseline] (1.233 s) : 0, 1232841
Total [baseline] (10.918 s) : 0, 10918371
Agent [candidate] (1.222 s) : 0, 1221533
Total [candidate] (10.894 s) : 0, 10894016
section iast
Agent [baseline] (1.183 s) : 0, 1183223
Total [baseline] (11.143 s) : 0, 11142961
Agent [candidate] (1.178 s) : 0, 1178332
Total [candidate] (11.151 s) : 0, 11151116
section profiling
Agent [baseline] (1.201 s) : 0, 1200996
Total [baseline] (10.931 s) : 0, 10931096
Agent [candidate] (1.201 s) : 0, 1201049
Total [candidate] (10.881 s) : 0, 10880884
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.051 s | - |
| Agent | appsec | 1.233 s | 181.774 ms (17.3%) |
| Agent | iast | 1.183 s | 132.155 ms (12.6%) |
| Agent | profiling | 1.201 s | 149.928 ms (14.3%) |
| Total | tracing | 10.866 s | - |
| Total | appsec | 10.918 s | 52.466 ms (0.5%) |
| Total | iast | 11.143 s | 277.055 ms (2.5%) |
| Total | profiling | 10.931 s | 65.191 ms (0.6%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.055 s | - |
| Agent | appsec | 1.222 s | 166.189 ms (15.7%) |
| Agent | iast | 1.178 s | 122.988 ms (11.7%) |
| Agent | profiling | 1.201 s | 145.706 ms (13.8%) |
| Total | tracing | 10.682 s | - |
| Total | appsec | 10.894 s | 211.924 ms (2.0%) |
| Total | iast | 11.151 s | 469.024 ms (4.4%) |
| Total | profiling | 10.881 s | 198.792 ms (1.9%) |
gantt
title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (708.127 ms) : 0, 708127
BytebuddyAgent [candidate] (710.836 ms) : 0, 710836
GlobalTracer [baseline] (245.944 ms) : 0, 245944
GlobalTracer [candidate] (247.474 ms) : 0, 247474
AppSec [baseline] (32.549 ms) : 0, 32549
AppSec [candidate] (32.605 ms) : 0, 32605
Debugger [baseline] (6.411 ms) : 0, 6411
Debugger [candidate] (6.483 ms) : 0, 6483
Remote Config [baseline] (715.575 µs) : 0, 716
Remote Config [candidate] (709.734 µs) : 0, 710
Telemetry [baseline] (13.602 ms) : 0, 13602
Telemetry [candidate] (13.679 ms) : 0, 13679
Flare Poller [baseline] (7.422 ms) : 0, 7422
Flare Poller [candidate] (7.205 ms) : 0, 7205
section appsec
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (736.049 ms) : 0, 736049
BytebuddyAgent [candidate] (729.355 ms) : 0, 729355
GlobalTracer [baseline] (239.627 ms) : 0, 239627
GlobalTracer [candidate] (237.222 ms) : 0, 237222
IAST [baseline] (25.238 ms) : 0, 25238
IAST [candidate] (25.027 ms) : 0, 25027
AppSec [baseline] (175.946 ms) : 0, 175946
AppSec [candidate] (174.605 ms) : 0, 174605
Debugger [baseline] (6.1 ms) : 0, 6100
Debugger [candidate] (5.992 ms) : 0, 5992
Remote Config [baseline] (656.972 µs) : 0, 657
Remote Config [candidate] (655.647 µs) : 0, 656
Telemetry [baseline] (8.696 ms) : 0, 8696
Telemetry [candidate] (8.471 ms) : 0, 8471
Flare Poller [baseline] (4.008 ms) : 0, 4008
Flare Poller [candidate] (3.982 ms) : 0, 3982
section iast
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (831.306 ms) : 0, 831306
BytebuddyAgent [candidate] (827.98 ms) : 0, 827980
GlobalTracer [baseline] (235.599 ms) : 0, 235599
GlobalTracer [candidate] (234.618 ms) : 0, 234618
IAST [baseline] (33.403 ms) : 0, 33403
IAST [candidate] (33.746 ms) : 0, 33746
AppSec [baseline] (27.687 ms) : 0, 27687
AppSec [candidate] (26.973 ms) : 0, 26973
Debugger [baseline] (5.975 ms) : 0, 5975
Debugger [candidate] (5.919 ms) : 0, 5919
Remote Config [baseline] (591.995 µs) : 0, 592
Remote Config [candidate] (585.964 µs) : 0, 586
Telemetry [baseline] (8.333 ms) : 0, 8333
Telemetry [candidate] (8.243 ms) : 0, 8243
Flare Poller [baseline] (4.097 ms) : 0, 4097
Flare Poller [candidate] (4.143 ms) : 0, 4143
section profiling
crashtracking [baseline] (1.447 ms) : 0, 1447
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (734.737 ms) : 0, 734737
BytebuddyAgent [candidate] (736.582 ms) : 0, 736582
GlobalTracer [baseline] (223.344 ms) : 0, 223344
GlobalTracer [candidate] (223.281 ms) : 0, 223281
AppSec [baseline] (32.515 ms) : 0, 32515
AppSec [candidate] (33.176 ms) : 0, 33176
Debugger [baseline] (9.084 ms) : 0, 9084
Debugger [candidate] (8.894 ms) : 0, 8894
Remote Config [baseline] (730.917 µs) : 0, 731
Remote Config [candidate] (677.821 µs) : 0, 678
Telemetry [baseline] (13.942 ms) : 0, 13942
Telemetry [candidate] (12.79 ms) : 0, 12790
Flare Poller [baseline] (4.193 ms) : 0, 4193
Flare Poller [candidate] (4.112 ms) : 0, 4112
ProfilingAgent [baseline] (110.819 ms) : 0, 110819
ProfilingAgent [candidate] (109.85 ms) : 0, 109850
Profiling [baseline] (111.506 ms) : 0, 111506
Profiling [candidate] (110.541 ms) : 0, 110541
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054903
Total [baseline] (8.638 s) : 0, 8638214
Agent [candidate] (1.06 s) : 0, 1060189
Total [candidate] (8.666 s) : 0, 8666146
section iast
Agent [baseline] (1.181 s) : 0, 1180663
Total [baseline] (9.242 s) : 0, 9241756
Agent [candidate] (1.197 s) : 0, 1197435
Total [candidate] (9.265 s) : 0, 9264602
- baseline results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.055 s | - |
| Agent | iast | 1.181 s | 125.76 ms (11.9%) |
| Total | tracing | 8.638 s | - |
| Total | iast | 9.242 s | 603.542 ms (7.0%) |
- candidate results
| Module | Variant | Duration | Δ tracing |
|---|---|---|---|
| Agent | tracing | 1.06 s | - |
| Agent | iast | 1.197 s | 137.247 ms (12.9%) |
| Total | tracing | 8.666 s | - |
| Total | iast | 9.265 s | 598.456 ms (6.9%) |
gantt
title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (710.299 ms) : 0, 710299
BytebuddyAgent [candidate] (713.894 ms) : 0, 713894
GlobalTracer [baseline] (247.491 ms) : 0, 247491
GlobalTracer [candidate] (248.538 ms) : 0, 248538
AppSec [baseline] (32.681 ms) : 0, 32681
AppSec [candidate] (33.004 ms) : 0, 33004
Debugger [baseline] (6.464 ms) : 0, 6464
Debugger [candidate] (6.529 ms) : 0, 6529
Remote Config [baseline] (721.385 µs) : 0, 721
Remote Config [candidate] (701.452 µs) : 0, 701
Telemetry [baseline] (14.453 ms) : 0, 14453
Telemetry [candidate] (12.29 ms) : 0, 12290
Flare Poller [baseline] (6.556 ms) : 0, 6556
Flare Poller [candidate] (8.757 ms) : 0, 8757
section iast
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (829.564 ms) : 0, 829564
BytebuddyAgent [candidate] (843.067 ms) : 0, 843067
GlobalTracer [baseline] (234.491 ms) : 0, 234491
GlobalTracer [candidate] (236.618 ms) : 0, 236618
IAST [baseline] (32.547 ms) : 0, 32547
IAST [candidate] (34.374 ms) : 0, 34374
AppSec [baseline] (28.619 ms) : 0, 28619
AppSec [candidate] (27.532 ms) : 0, 27532
Debugger [baseline] (6.037 ms) : 0, 6037
Debugger [candidate] (6.062 ms) : 0, 6062
Remote Config [baseline] (605.089 µs) : 0, 605
Remote Config [candidate] (604.884 µs) : 0, 605
Telemetry [baseline] (8.446 ms) : 0, 8446
Telemetry [candidate] (8.579 ms) : 0, 8579
Flare Poller [baseline] (4.101 ms) : 0, 4101
Flare Poller [candidate] (4.159 ms) : 0, 4159
Load
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | zgu/profiler_nightly_test |
| git_commit_date | 1762533227 | 1762534631 |
| git_commit_sha | 54da873ecc | cb69d71194 |
| release_version | 1.56.0-SNAPSHOT~54da873ecc | 1.56.0-SNAPSHOT~cb69d71194 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | insecure-bank | insecure-bank |
| ci_job_date | 1762537309 | 1762537309 |
| ci_job_id | 1222847157 | 1222847157 |
| ci_pipeline_id | 81621344 | 81621344 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-sv9p466s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-sv9p466s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 1 performance improvements and 5 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.
| scenario | Δ mean http_req_duration | Δ mean throughput | candidate mean http_req_duration | candidate mean throughput | baseline mean http_req_duration | baseline mean throughput |
|---|---|---|---|---|---|---|
| scenario:load:insecure-bank:iast_FULL:high_load | worse [+237.330µs; +365.835µs] or [+4.164%; +6.419%] |
unstable [-113.895op/s; +33.832op/s] or [-14.045%; +4.172%] |
6.001ms | 770.906op/s | 5.700ms | 810.938op/s |
| scenario:load:insecure-bank:iast:high_load | worse [+117.993µs; +209.562µs] or [+3.794%; +6.739%] |
unstable [-221.827op/s; +78.577op/s] or [-15.094%; +5.347%] |
3.274ms | 1398.000op/s | 3.110ms | 1469.625op/s |
| scenario:load:petclinic:profiling:high_load | worse [+777.610µs; +1193.882µs] or [+4.134%; +6.347%] |
unstable [-37.113op/s; +12.550op/s] or [-14.955%; +5.057%] |
19.795ms | 235.875op/s | 18.809ms | 248.156op/s |
| scenario:load:petclinic:appsec:high_load | worse [+475.896µs; +893.856µs] or [+2.541%; +4.772%] |
unstable [-33.904op/s; +16.342op/s] or [-13.604%; +6.557%] |
19.415ms | 240.438op/s | 18.730ms | 249.219op/s |
| scenario:load:petclinic:iast:high_load | worse [+790.745µs; +1191.015µs] or [+4.430%; +6.672%] |
unstable [-40.015op/s; +12.640op/s] or [-15.306%; +4.835%] |
18.842ms | 247.750op/s | 17.851ms | 261.438op/s |
| scenario:load:petclinic:no_agent:high_load | better [-1077.131µs; -667.932µs] or [-5.656%; -3.507%] |
unstable [-15.689op/s; +39.189op/s] or [-6.402%; +15.991%] |
18.172ms | 256.812op/s | 19.045ms | 245.062op/s |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
dateFormat X
axisFormat %s
section baseline
no_agent (1.193 ms) : 1182, 1205
. : milestone, 1193,
iast (3.11 ms) : 3071, 3149
. : milestone, 3110,
iast_FULL (5.7 ms) : 5642, 5757
. : milestone, 5700,
iast_GLOBAL (3.662 ms) : 3609, 3715
. : milestone, 3662,
profiling (1.94 ms) : 1923, 1957
. : milestone, 1940,
tracing (1.791 ms) : 1775, 1806
. : milestone, 1791,
section candidate
no_agent (1.191 ms) : 1179, 1203
. : milestone, 1191,
iast (3.274 ms) : 3228, 3320
. : milestone, 3274,
iast_FULL (6.001 ms) : 5939, 6063
. : milestone, 6001,
iast_GLOBAL (3.653 ms) : 3593, 3713
. : milestone, 3653,
profiling (1.978 ms) : 1961, 1995
. : milestone, 1978,
tracing (1.787 ms) : 1773, 1801
. : milestone, 1787,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.193 ms [1.182 ms, 1.205 ms] | - |
| iast | 3.11 ms [3.071 ms, 3.149 ms] | 1.917 ms (160.6%) |
| iast_FULL | 5.7 ms [5.642 ms, 5.757 ms] | 4.506 ms (377.7%) |
| iast_GLOBAL | 3.662 ms [3.609 ms, 3.715 ms] | 2.469 ms (206.9%) |
| profiling | 1.94 ms [1.923 ms, 1.957 ms] | 746.948 µs (62.6%) |
| tracing | 1.791 ms [1.775 ms, 1.806 ms] | 597.375 µs (50.1%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.191 ms [1.179 ms, 1.203 ms] | - |
| iast | 3.274 ms [3.228 ms, 3.32 ms] | 2.082 ms (174.8%) |
| iast_FULL | 6.001 ms [5.939 ms, 6.063 ms] | 4.81 ms (403.7%) |
| iast_GLOBAL | 3.653 ms [3.593 ms, 3.713 ms] | 2.461 ms (206.6%) |
| profiling | 1.978 ms [1.961 ms, 1.995 ms] | 787.123 µs (66.1%) |
| tracing | 1.787 ms [1.773 ms, 1.801 ms] | 595.57 µs (50.0%) |
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
dateFormat X
axisFormat %s
section baseline
no_agent (19.045 ms) : 18848, 19242
. : milestone, 19045,
appsec (18.73 ms) : 18542, 18918
. : milestone, 18730,
code_origins (17.641 ms) : 17466, 17817
. : milestone, 17641,
iast (17.851 ms) : 17675, 18027
. : milestone, 17851,
profiling (18.809 ms) : 18618, 19000
. : milestone, 18809,
tracing (17.732 ms) : 17554, 17909
. : milestone, 17732,
section candidate
no_agent (18.172 ms) : 17990, 18355
. : milestone, 18172,
appsec (19.415 ms) : 19215, 19615
. : milestone, 19415,
code_origins (17.689 ms) : 17514, 17864
. : milestone, 17689,
iast (18.842 ms) : 18646, 19037
. : milestone, 18842,
profiling (19.795 ms) : 19599, 19991
. : milestone, 19795,
tracing (17.692 ms) : 17515, 17870
. : milestone, 17692,
- baseline results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 19.045 ms [18.848 ms, 19.242 ms] | - |
| appsec | 18.73 ms [18.542 ms, 18.918 ms] | -315.005 µs (-1.7%) |
| code_origins | 17.641 ms [17.466 ms, 17.817 ms] | -1.404 ms (-7.4%) |
| iast | 17.851 ms [17.675 ms, 18.027 ms] | -1.194 ms (-6.3%) |
| profiling | 18.809 ms [18.618 ms, 19.0 ms] | -235.96 µs (-1.2%) |
| tracing | 17.732 ms [17.554 ms, 17.909 ms] | -1.313 ms (-6.9%) |
- candidate results
| Variant | Request duration [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 18.172 ms [17.99 ms, 18.355 ms] | - |
| appsec | 19.415 ms [19.215 ms, 19.615 ms] | 1.242 ms (6.8%) |
| code_origins | 17.689 ms [17.514 ms, 17.864 ms] | -483.278 µs (-2.7%) |
| iast | 18.842 ms [18.646 ms, 19.037 ms] | 669.226 µs (3.7%) |
| profiling | 19.795 ms [19.599 ms, 19.991 ms] | 1.622 ms (8.9%) |
| tracing | 17.692 ms [17.515 ms, 17.87 ms] | -480.158 µs (-2.6%) |
Dacapo
Parameters
| Baseline | Candidate | |
|---|---|---|
| baseline_or_candidate | baseline | candidate |
| git_branch | master | zgu/profiler_nightly_test |
| git_commit_date | 1762533227 | 1762534631 |
| git_commit_sha | 54da873ecc | cb69d71194 |
| release_version | 1.56.0-SNAPSHOT~54da873ecc | 1.56.0-SNAPSHOT~cb69d71194 |
See matching parameters
| Baseline | Candidate | |
|---|---|---|
| application | biojava | biojava |
| ci_job_date | 1762536955 | 1762536955 |
| ci_job_id | 1222847158 | 1222847158 |
| ci_pipeline_id | 81621344 | 81621344 |
| cpu_model | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |
| kernel_version | Linux runner-zfyrx7zua-project-304-concurrent-0-2ij43ft9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux | Linux runner-zfyrx7zua-project-304-concurrent-0-2ij43ft9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
dateFormat X
axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
. : milestone, 1471,
appsec (3.702 ms) : 3484, 3920
. : milestone, 3702,
iast (2.205 ms) : 2142, 2269
. : milestone, 2205,
iast_GLOBAL (2.238 ms) : 2174, 2302
. : milestone, 2238,
profiling (2.052 ms) : 2000, 2103
. : milestone, 2052,
tracing (2.025 ms) : 1975, 2074
. : milestone, 2025,
section candidate
no_agent (1.479 ms) : 1467, 1490
. : milestone, 1479,
appsec (3.714 ms) : 3496, 3932
. : milestone, 3714,
iast (2.202 ms) : 2138, 2265
. : milestone, 2202,
iast_GLOBAL (2.247 ms) : 2183, 2310
. : milestone, 2247,
profiling (2.053 ms) : 2002, 2104
. : milestone, 2053,
tracing (2.026 ms) : 1976, 2076
. : milestone, 2026,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.471 ms [1.46 ms, 1.483 ms] | - |
| appsec | 3.702 ms [3.484 ms, 3.92 ms] | 2.231 ms (151.6%) |
| iast | 2.205 ms [2.142 ms, 2.269 ms] | 734.044 µs (49.9%) |
| iast_GLOBAL | 2.238 ms [2.174 ms, 2.302 ms] | 766.477 µs (52.1%) |
| profiling | 2.052 ms [2.0 ms, 2.103 ms] | 580.62 µs (39.5%) |
| tracing | 2.025 ms [1.975 ms, 2.074 ms] | 553.366 µs (37.6%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 1.479 ms [1.467 ms, 1.49 ms] | - |
| appsec | 3.714 ms [3.496 ms, 3.932 ms] | 2.235 ms (151.2%) |
| iast | 2.202 ms [2.138 ms, 2.265 ms] | 723.136 µs (48.9%) |
| iast_GLOBAL | 2.247 ms [2.183 ms, 2.31 ms] | 768.141 µs (52.0%) |
| profiling | 2.053 ms [2.002 ms, 2.104 ms] | 574.41 µs (38.8%) |
| tracing | 2.026 ms [1.976 ms, 2.076 ms] | 547.632 µs (37.0%) |
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
dateFormat X
axisFormat %s
section baseline
no_agent (14.974 s) : 14974000, 14974000
. : milestone, 14974000,
appsec (14.811 s) : 14811000, 14811000
. : milestone, 14811000,
iast (18.563 s) : 18563000, 18563000
. : milestone, 18563000,
iast_GLOBAL (18.007 s) : 18007000, 18007000
. : milestone, 18007000,
profiling (14.951 s) : 14951000, 14951000
. : milestone, 14951000,
tracing (14.731 s) : 14731000, 14731000
. : milestone, 14731000,
section candidate
no_agent (14.9 s) : 14900000, 14900000
. : milestone, 14900000,
appsec (14.944 s) : 14944000, 14944000
. : milestone, 14944000,
iast (18.573 s) : 18573000, 18573000
. : milestone, 18573000,
iast_GLOBAL (18.247 s) : 18247000, 18247000
. : milestone, 18247000,
profiling (15.23 s) : 15230000, 15230000
. : milestone, 15230000,
tracing (14.543 s) : 14543000, 14543000
. : milestone, 14543000,
- baseline results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 14.974 s [14.974 s, 14.974 s] | - |
| appsec | 14.811 s [14.811 s, 14.811 s] | -163.0 ms (-1.1%) |
| iast | 18.563 s [18.563 s, 18.563 s] | 3.589 s (24.0%) |
| iast_GLOBAL | 18.007 s [18.007 s, 18.007 s] | 3.033 s (20.3%) |
| profiling | 14.951 s [14.951 s, 14.951 s] | -23.0 ms (-0.2%) |
| tracing | 14.731 s [14.731 s, 14.731 s] | -243.0 ms (-1.6%) |
- candidate results
| Variant | Execution Time [CI 0.99] | Δ no_agent |
|---|---|---|
| no_agent | 14.9 s [14.9 s, 14.9 s] | - |
| appsec | 14.944 s [14.944 s, 14.944 s] | 44.0 ms (0.3%) |
| iast | 18.573 s [18.573 s, 18.573 s] | 3.673 s (24.7%) |
| iast_GLOBAL | 18.247 s [18.247 s, 18.247 s] | 3.347 s (22.5%) |
| profiling | 15.23 s [15.23 s, 15.23 s] | 330.0 ms (2.2%) |
| tracing | 14.543 s [14.543 s, 14.543 s] | -357.0 ms (-2.4%) |
One thing I'm not sure, is where the nightly gets published ?
Technically, it is not a nightly, but a snapshot built from 'main' after each integration. And it is published in sonatype snapshots repo.