dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

Using ddprof nightly snapshot for nightly test

Open zhengyu123 opened this issue 3 months ago • 3 comments

What Does This Do

Allows dd-trace-java's nightly test to use java-profiler's latest snapshot.

Motivation

Up to now, dd-trace-java always uses latest release version of java-profiler for testing, that means java-profiler does not get any integration tests until it has been released.

With the PR, java-profiler gets early exposure to dd-trace-java's nightly test, should help to catch any integration problems and improve test coverage.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

zhengyu123 avatar Nov 07 '25 17:11 zhengyu123

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 59.60% (-0.04%)
View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: cb69d71 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master zgu/profiler_nightly_test
git_commit_date 1762533227 1762534631
git_commit_sha 54da873ecc cb69d71194
release_version 1.56.0-SNAPSHOT~54da873ecc 1.56.0-SNAPSHOT~cb69d71194
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762536825 1762536825
ci_job_id 1222847156 1222847156
ci_pipeline_id 81621344 81621344
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-jipb4pyw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-jipb4pyw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 12 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051067
Total [baseline] (10.866 s) : 0, 10865905
Agent [candidate] (1.055 s) : 0, 1055344
Total [candidate] (10.682 s) : 0, 10682092
section appsec
Agent [baseline] (1.233 s) : 0, 1232841
Total [baseline] (10.918 s) : 0, 10918371
Agent [candidate] (1.222 s) : 0, 1221533
Total [candidate] (10.894 s) : 0, 10894016
section iast
Agent [baseline] (1.183 s) : 0, 1183223
Total [baseline] (11.143 s) : 0, 11142961
Agent [candidate] (1.178 s) : 0, 1178332
Total [candidate] (11.151 s) : 0, 11151116
section profiling
Agent [baseline] (1.201 s) : 0, 1200996
Total [baseline] (10.931 s) : 0, 10931096
Agent [candidate] (1.201 s) : 0, 1201049
Total [candidate] (10.881 s) : 0, 10880884
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent appsec 1.233 s 181.774 ms (17.3%)
Agent iast 1.183 s 132.155 ms (12.6%)
Agent profiling 1.201 s 149.928 ms (14.3%)
Total tracing 10.866 s -
Total appsec 10.918 s 52.466 ms (0.5%)
Total iast 11.143 s 277.055 ms (2.5%)
Total profiling 10.931 s 65.191 ms (0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.222 s 166.189 ms (15.7%)
Agent iast 1.178 s 122.988 ms (11.7%)
Agent profiling 1.201 s 145.706 ms (13.8%)
Total tracing 10.682 s -
Total appsec 10.894 s 211.924 ms (2.0%)
Total iast 11.151 s 469.024 ms (4.4%)
Total profiling 10.881 s 198.792 ms (1.9%)
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (708.127 ms) : 0, 708127
BytebuddyAgent [candidate] (710.836 ms) : 0, 710836
GlobalTracer [baseline] (245.944 ms) : 0, 245944
GlobalTracer [candidate] (247.474 ms) : 0, 247474
AppSec [baseline] (32.549 ms) : 0, 32549
AppSec [candidate] (32.605 ms) : 0, 32605
Debugger [baseline] (6.411 ms) : 0, 6411
Debugger [candidate] (6.483 ms) : 0, 6483
Remote Config [baseline] (715.575 µs) : 0, 716
Remote Config [candidate] (709.734 µs) : 0, 710
Telemetry [baseline] (13.602 ms) : 0, 13602
Telemetry [candidate] (13.679 ms) : 0, 13679
Flare Poller [baseline] (7.422 ms) : 0, 7422
Flare Poller [candidate] (7.205 ms) : 0, 7205
section appsec
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (736.049 ms) : 0, 736049
BytebuddyAgent [candidate] (729.355 ms) : 0, 729355
GlobalTracer [baseline] (239.627 ms) : 0, 239627
GlobalTracer [candidate] (237.222 ms) : 0, 237222
IAST [baseline] (25.238 ms) : 0, 25238
IAST [candidate] (25.027 ms) : 0, 25027
AppSec [baseline] (175.946 ms) : 0, 175946
AppSec [candidate] (174.605 ms) : 0, 174605
Debugger [baseline] (6.1 ms) : 0, 6100
Debugger [candidate] (5.992 ms) : 0, 5992
Remote Config [baseline] (656.972 µs) : 0, 657
Remote Config [candidate] (655.647 µs) : 0, 656
Telemetry [baseline] (8.696 ms) : 0, 8696
Telemetry [candidate] (8.471 ms) : 0, 8471
Flare Poller [baseline] (4.008 ms) : 0, 4008
Flare Poller [candidate] (3.982 ms) : 0, 3982
section iast
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (831.306 ms) : 0, 831306
BytebuddyAgent [candidate] (827.98 ms) : 0, 827980
GlobalTracer [baseline] (235.599 ms) : 0, 235599
GlobalTracer [candidate] (234.618 ms) : 0, 234618
IAST [baseline] (33.403 ms) : 0, 33403
IAST [candidate] (33.746 ms) : 0, 33746
AppSec [baseline] (27.687 ms) : 0, 27687
AppSec [candidate] (26.973 ms) : 0, 26973
Debugger [baseline] (5.975 ms) : 0, 5975
Debugger [candidate] (5.919 ms) : 0, 5919
Remote Config [baseline] (591.995 µs) : 0, 592
Remote Config [candidate] (585.964 µs) : 0, 586
Telemetry [baseline] (8.333 ms) : 0, 8333
Telemetry [candidate] (8.243 ms) : 0, 8243
Flare Poller [baseline] (4.097 ms) : 0, 4097
Flare Poller [candidate] (4.143 ms) : 0, 4143
section profiling
crashtracking [baseline] (1.447 ms) : 0, 1447
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (734.737 ms) : 0, 734737
BytebuddyAgent [candidate] (736.582 ms) : 0, 736582
GlobalTracer [baseline] (223.344 ms) : 0, 223344
GlobalTracer [candidate] (223.281 ms) : 0, 223281
AppSec [baseline] (32.515 ms) : 0, 32515
AppSec [candidate] (33.176 ms) : 0, 33176
Debugger [baseline] (9.084 ms) : 0, 9084
Debugger [candidate] (8.894 ms) : 0, 8894
Remote Config [baseline] (730.917 µs) : 0, 731
Remote Config [candidate] (677.821 µs) : 0, 678
Telemetry [baseline] (13.942 ms) : 0, 13942
Telemetry [candidate] (12.79 ms) : 0, 12790
Flare Poller [baseline] (4.193 ms) : 0, 4193
Flare Poller [candidate] (4.112 ms) : 0, 4112
ProfilingAgent [baseline] (110.819 ms) : 0, 110819
ProfilingAgent [candidate] (109.85 ms) : 0, 109850
Profiling [baseline] (111.506 ms) : 0, 111506
Profiling [candidate] (110.541 ms) : 0, 110541
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054903
Total [baseline] (8.638 s) : 0, 8638214
Agent [candidate] (1.06 s) : 0, 1060189
Total [candidate] (8.666 s) : 0, 8666146
section iast
Agent [baseline] (1.181 s) : 0, 1180663
Total [baseline] (9.242 s) : 0, 9241756
Agent [candidate] (1.197 s) : 0, 1197435
Total [candidate] (9.265 s) : 0, 9264602
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.181 s 125.76 ms (11.9%)
Total tracing 8.638 s -
Total iast 9.242 s 603.542 ms (7.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.197 s 137.247 ms (12.9%)
Total tracing 8.666 s -
Total iast 9.265 s 598.456 ms (6.9%)
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (710.299 ms) : 0, 710299
BytebuddyAgent [candidate] (713.894 ms) : 0, 713894
GlobalTracer [baseline] (247.491 ms) : 0, 247491
GlobalTracer [candidate] (248.538 ms) : 0, 248538
AppSec [baseline] (32.681 ms) : 0, 32681
AppSec [candidate] (33.004 ms) : 0, 33004
Debugger [baseline] (6.464 ms) : 0, 6464
Debugger [candidate] (6.529 ms) : 0, 6529
Remote Config [baseline] (721.385 µs) : 0, 721
Remote Config [candidate] (701.452 µs) : 0, 701
Telemetry [baseline] (14.453 ms) : 0, 14453
Telemetry [candidate] (12.29 ms) : 0, 12290
Flare Poller [baseline] (6.556 ms) : 0, 6556
Flare Poller [candidate] (8.757 ms) : 0, 8757
section iast
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (829.564 ms) : 0, 829564
BytebuddyAgent [candidate] (843.067 ms) : 0, 843067
GlobalTracer [baseline] (234.491 ms) : 0, 234491
GlobalTracer [candidate] (236.618 ms) : 0, 236618
IAST [baseline] (32.547 ms) : 0, 32547
IAST [candidate] (34.374 ms) : 0, 34374
AppSec [baseline] (28.619 ms) : 0, 28619
AppSec [candidate] (27.532 ms) : 0, 27532
Debugger [baseline] (6.037 ms) : 0, 6037
Debugger [candidate] (6.062 ms) : 0, 6062
Remote Config [baseline] (605.089 µs) : 0, 605
Remote Config [candidate] (604.884 µs) : 0, 605
Telemetry [baseline] (8.446 ms) : 0, 8446
Telemetry [candidate] (8.579 ms) : 0, 8579
Flare Poller [baseline] (4.101 ms) : 0, 4101
Flare Poller [candidate] (4.159 ms) : 0, 4159

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master zgu/profiler_nightly_test
git_commit_date 1762533227 1762534631
git_commit_sha 54da873ecc cb69d71194
release_version 1.56.0-SNAPSHOT~54da873ecc 1.56.0-SNAPSHOT~cb69d71194
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762537309 1762537309
ci_job_id 1222847157 1222847157
ci_pipeline_id 81621344 81621344
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-sv9p466s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-sv9p466s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 5 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load worse
[+237.330µs; +365.835µs] or [+4.164%; +6.419%]
unstable
[-113.895op/s; +33.832op/s] or [-14.045%; +4.172%]
6.001ms 770.906op/s 5.700ms 810.938op/s
scenario:load:insecure-bank:iast:high_load worse
[+117.993µs; +209.562µs] or [+3.794%; +6.739%]
unstable
[-221.827op/s; +78.577op/s] or [-15.094%; +5.347%]
3.274ms 1398.000op/s 3.110ms 1469.625op/s
scenario:load:petclinic:profiling:high_load worse
[+777.610µs; +1193.882µs] or [+4.134%; +6.347%]
unstable
[-37.113op/s; +12.550op/s] or [-14.955%; +5.057%]
19.795ms 235.875op/s 18.809ms 248.156op/s
scenario:load:petclinic:appsec:high_load worse
[+475.896µs; +893.856µs] or [+2.541%; +4.772%]
unstable
[-33.904op/s; +16.342op/s] or [-13.604%; +6.557%]
19.415ms 240.438op/s 18.730ms 249.219op/s
scenario:load:petclinic:iast:high_load worse
[+790.745µs; +1191.015µs] or [+4.430%; +6.672%]
unstable
[-40.015op/s; +12.640op/s] or [-15.306%; +4.835%]
18.842ms 247.750op/s 17.851ms 261.438op/s
scenario:load:petclinic:no_agent:high_load better
[-1077.131µs; -667.932µs] or [-5.656%; -3.507%]
unstable
[-15.689op/s; +39.189op/s] or [-6.402%; +15.991%]
18.172ms 256.812op/s 19.045ms 245.062op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.193 ms) : 1182, 1205
.   : milestone, 1193,
iast (3.11 ms) : 3071, 3149
.   : milestone, 3110,
iast_FULL (5.7 ms) : 5642, 5757
.   : milestone, 5700,
iast_GLOBAL (3.662 ms) : 3609, 3715
.   : milestone, 3662,
profiling (1.94 ms) : 1923, 1957
.   : milestone, 1940,
tracing (1.791 ms) : 1775, 1806
.   : milestone, 1791,
section candidate
no_agent (1.191 ms) : 1179, 1203
.   : milestone, 1191,
iast (3.274 ms) : 3228, 3320
.   : milestone, 3274,
iast_FULL (6.001 ms) : 5939, 6063
.   : milestone, 6001,
iast_GLOBAL (3.653 ms) : 3593, 3713
.   : milestone, 3653,
profiling (1.978 ms) : 1961, 1995
.   : milestone, 1978,
tracing (1.787 ms) : 1773, 1801
.   : milestone, 1787,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.193 ms [1.182 ms, 1.205 ms] -
iast 3.11 ms [3.071 ms, 3.149 ms] 1.917 ms (160.6%)
iast_FULL 5.7 ms [5.642 ms, 5.757 ms] 4.506 ms (377.7%)
iast_GLOBAL 3.662 ms [3.609 ms, 3.715 ms] 2.469 ms (206.9%)
profiling 1.94 ms [1.923 ms, 1.957 ms] 746.948 µs (62.6%)
tracing 1.791 ms [1.775 ms, 1.806 ms] 597.375 µs (50.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.179 ms, 1.203 ms] -
iast 3.274 ms [3.228 ms, 3.32 ms] 2.082 ms (174.8%)
iast_FULL 6.001 ms [5.939 ms, 6.063 ms] 4.81 ms (403.7%)
iast_GLOBAL 3.653 ms [3.593 ms, 3.713 ms] 2.461 ms (206.6%)
profiling 1.978 ms [1.961 ms, 1.995 ms] 787.123 µs (66.1%)
tracing 1.787 ms [1.773 ms, 1.801 ms] 595.57 µs (50.0%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.045 ms) : 18848, 19242
.   : milestone, 19045,
appsec (18.73 ms) : 18542, 18918
.   : milestone, 18730,
code_origins (17.641 ms) : 17466, 17817
.   : milestone, 17641,
iast (17.851 ms) : 17675, 18027
.   : milestone, 17851,
profiling (18.809 ms) : 18618, 19000
.   : milestone, 18809,
tracing (17.732 ms) : 17554, 17909
.   : milestone, 17732,
section candidate
no_agent (18.172 ms) : 17990, 18355
.   : milestone, 18172,
appsec (19.415 ms) : 19215, 19615
.   : milestone, 19415,
code_origins (17.689 ms) : 17514, 17864
.   : milestone, 17689,
iast (18.842 ms) : 18646, 19037
.   : milestone, 18842,
profiling (19.795 ms) : 19599, 19991
.   : milestone, 19795,
tracing (17.692 ms) : 17515, 17870
.   : milestone, 17692,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.045 ms [18.848 ms, 19.242 ms] -
appsec 18.73 ms [18.542 ms, 18.918 ms] -315.005 µs (-1.7%)
code_origins 17.641 ms [17.466 ms, 17.817 ms] -1.404 ms (-7.4%)
iast 17.851 ms [17.675 ms, 18.027 ms] -1.194 ms (-6.3%)
profiling 18.809 ms [18.618 ms, 19.0 ms] -235.96 µs (-1.2%)
tracing 17.732 ms [17.554 ms, 17.909 ms] -1.313 ms (-6.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.172 ms [17.99 ms, 18.355 ms] -
appsec 19.415 ms [19.215 ms, 19.615 ms] 1.242 ms (6.8%)
code_origins 17.689 ms [17.514 ms, 17.864 ms] -483.278 µs (-2.7%)
iast 18.842 ms [18.646 ms, 19.037 ms] 669.226 µs (3.7%)
profiling 19.795 ms [19.599 ms, 19.991 ms] 1.622 ms (8.9%)
tracing 17.692 ms [17.515 ms, 17.87 ms] -480.158 µs (-2.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master zgu/profiler_nightly_test
git_commit_date 1762533227 1762534631
git_commit_sha 54da873ecc cb69d71194
release_version 1.56.0-SNAPSHOT~54da873ecc 1.56.0-SNAPSHOT~cb69d71194
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1762536955 1762536955
ci_job_id 1222847158 1222847158
ci_pipeline_id 81621344 81621344
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-2ij43ft9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-2ij43ft9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.702 ms) : 3484, 3920
.   : milestone, 3702,
iast (2.205 ms) : 2142, 2269
.   : milestone, 2205,
iast_GLOBAL (2.238 ms) : 2174, 2302
.   : milestone, 2238,
profiling (2.052 ms) : 2000, 2103
.   : milestone, 2052,
tracing (2.025 ms) : 1975, 2074
.   : milestone, 2025,
section candidate
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (3.714 ms) : 3496, 3932
.   : milestone, 3714,
iast (2.202 ms) : 2138, 2265
.   : milestone, 2202,
iast_GLOBAL (2.247 ms) : 2183, 2310
.   : milestone, 2247,
profiling (2.053 ms) : 2002, 2104
.   : milestone, 2053,
tracing (2.026 ms) : 1976, 2076
.   : milestone, 2026,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.702 ms [3.484 ms, 3.92 ms] 2.231 ms (151.6%)
iast 2.205 ms [2.142 ms, 2.269 ms] 734.044 µs (49.9%)
iast_GLOBAL 2.238 ms [2.174 ms, 2.302 ms] 766.477 µs (52.1%)
profiling 2.052 ms [2.0 ms, 2.103 ms] 580.62 µs (39.5%)
tracing 2.025 ms [1.975 ms, 2.074 ms] 553.366 µs (37.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 3.714 ms [3.496 ms, 3.932 ms] 2.235 ms (151.2%)
iast 2.202 ms [2.138 ms, 2.265 ms] 723.136 µs (48.9%)
iast_GLOBAL 2.247 ms [2.183 ms, 2.31 ms] 768.141 µs (52.0%)
profiling 2.053 ms [2.002 ms, 2.104 ms] 574.41 µs (38.8%)
tracing 2.026 ms [1.976 ms, 2.076 ms] 547.632 µs (37.0%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~cb69d71194, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.974 s) : 14974000, 14974000
.   : milestone, 14974000,
appsec (14.811 s) : 14811000, 14811000
.   : milestone, 14811000,
iast (18.563 s) : 18563000, 18563000
.   : milestone, 18563000,
iast_GLOBAL (18.007 s) : 18007000, 18007000
.   : milestone, 18007000,
profiling (14.951 s) : 14951000, 14951000
.   : milestone, 14951000,
tracing (14.731 s) : 14731000, 14731000
.   : milestone, 14731000,
section candidate
no_agent (14.9 s) : 14900000, 14900000
.   : milestone, 14900000,
appsec (14.944 s) : 14944000, 14944000
.   : milestone, 14944000,
iast (18.573 s) : 18573000, 18573000
.   : milestone, 18573000,
iast_GLOBAL (18.247 s) : 18247000, 18247000
.   : milestone, 18247000,
profiling (15.23 s) : 15230000, 15230000
.   : milestone, 15230000,
tracing (14.543 s) : 14543000, 14543000
.   : milestone, 14543000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.974 s [14.974 s, 14.974 s] -
appsec 14.811 s [14.811 s, 14.811 s] -163.0 ms (-1.1%)
iast 18.563 s [18.563 s, 18.563 s] 3.589 s (24.0%)
iast_GLOBAL 18.007 s [18.007 s, 18.007 s] 3.033 s (20.3%)
profiling 14.951 s [14.951 s, 14.951 s] -23.0 ms (-0.2%)
tracing 14.731 s [14.731 s, 14.731 s] -243.0 ms (-1.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.9 s [14.9 s, 14.9 s] -
appsec 14.944 s [14.944 s, 14.944 s] 44.0 ms (0.3%)
iast 18.573 s [18.573 s, 18.573 s] 3.673 s (24.7%)
iast_GLOBAL 18.247 s [18.247 s, 18.247 s] 3.347 s (22.5%)
profiling 15.23 s [15.23 s, 15.23 s] 330.0 ms (2.2%)
tracing 14.543 s [14.543 s, 14.543 s] -357.0 ms (-2.4%)

pr-commenter[bot] avatar Nov 07 '25 17:11 pr-commenter[bot]

One thing I'm not sure, is where the nightly gets published ?

Technically, it is not a nightly, but a snapshot built from 'main' after each integration. And it is published in sonatype snapshots repo.

jbachorik avatar Nov 10 '25 14:11 jbachorik