dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

testing how tests behave in the CI

Open vandonr opened this issue 5 months ago • 2 comments

What Does This Do

maybe https://github.com/testcontainers/testcontainers-java/issues/6938

test fails with

ContainerLaunchException: Container startup failed for image registry.ddbuild.io/images/mirror/couchbase/server:7.1.0
...
at CouchbaseClient31Test.setupSpec(CouchbaseClient31Test.groovy:47)

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

vandonr avatar Sep 10 '25 09:09 vandonr

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 60.12% (-0.01%)
View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: d58f083 | Docs | Was this helpful? Give us feedback!

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vandonr/fix2
git_commit_date 1757594538 1757596037
git_commit_sha 2349c6ec12 d58f083a29
release_version 1.54.0-SNAPSHOT~2349c6ec12 1.54.0-SNAPSHOT~d58f083a29
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1757597857 1757597857
ci_job_id 1124498951 1124498951
ci_pipeline_id 76188153 76188153
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-2fel4lp2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-2fel4lp2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1046411
Total [baseline] (8.625 s) : 0, 8624722
Agent [candidate] (1.054 s) : 0, 1054367
Total [candidate] (8.618 s) : 0, 8618420
section iast
Agent [baseline] (1.19 s) : 0, 1189988
Total [baseline] (9.328 s) : 0, 9327901
Agent [candidate] (1.183 s) : 0, 1183326
Total [candidate] (9.369 s) : 0, 9368869
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent iast 1.19 s 143.577 ms (13.7%)
Total tracing 8.625 s -
Total iast 9.328 s 703.179 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent iast 1.183 s 128.959 ms (12.2%)
Total tracing 8.618 s -
Total iast 9.369 s 750.449 ms (8.7%)
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (732.258 ms) : 0, 732258
BytebuddyAgent [candidate] (738.587 ms) : 0, 738587
GlobalTracer [baseline] (242.31 ms) : 0, 242310
GlobalTracer [candidate] (243.801 ms) : 0, 243801
AppSec [baseline] (30.526 ms) : 0, 30526
AppSec [candidate] (30.547 ms) : 0, 30547
Debugger [baseline] (6.512 ms) : 0, 6512
Debugger [candidate] (6.473 ms) : 0, 6473
Remote Config [baseline] (678.345 µs) : 0, 678
Remote Config [candidate] (674.351 µs) : 0, 674
Telemetry [baseline] (11.666 ms) : 0, 11666
Telemetry [candidate] (11.707 ms) : 0, 11707
section iast
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (859.556 ms) : 0, 859556
BytebuddyAgent [candidate] (853.923 ms) : 0, 853923
GlobalTracer [baseline] (234.297 ms) : 0, 234297
GlobalTracer [candidate] (233.781 ms) : 0, 233781
AppSec [baseline] (28.82 ms) : 0, 28820
AppSec [candidate] (26.816 ms) : 0, 26816
Debugger [baseline] (6.149 ms) : 0, 6149
Debugger [candidate] (6.155 ms) : 0, 6155
Remote Config [baseline] (604.465 µs) : 0, 604
Remote Config [candidate] (594.507 µs) : 0, 595
Telemetry [baseline] (8.365 ms) : 0, 8365
Telemetry [candidate] (8.341 ms) : 0, 8341
IAST [baseline] (29.622 ms) : 0, 29622
IAST [candidate] (31.206 ms) : 0, 31206
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.048 s) : 0, 1048403
Total [baseline] (10.724 s) : 0, 10723774
Agent [candidate] (1.048 s) : 0, 1048442
Total [candidate] (10.609 s) : 0, 10609031
section appsec
Agent [baseline] (1.226 s) : 0, 1225541
Total [baseline] (10.797 s) : 0, 10796890
Agent [candidate] (1.221 s) : 0, 1220880
Total [candidate] (10.771 s) : 0, 10771381
section iast
Agent [baseline] (1.181 s) : 0, 1181230
Total [baseline] (10.947 s) : 0, 10947174
Agent [candidate] (1.179 s) : 0, 1179087
Total [candidate] (10.919 s) : 0, 10919308
section profiling
Agent [baseline] (1.209 s) : 0, 1209306
Total [baseline] (11.005 s) : 0, 11005482
Agent [candidate] (1.207 s) : 0, 1207326
Total [candidate] (10.971 s) : 0, 10971087
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent appsec 1.226 s 177.138 ms (16.9%)
Agent iast 1.181 s 132.827 ms (12.7%)
Agent profiling 1.209 s 160.903 ms (15.3%)
Total tracing 10.724 s -
Total appsec 10.797 s 73.116 ms (0.7%)
Total iast 10.947 s 223.4 ms (2.1%)
Total profiling 11.005 s 281.708 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent appsec 1.221 s 172.438 ms (16.4%)
Agent iast 1.179 s 130.645 ms (12.5%)
Agent profiling 1.207 s 158.883 ms (15.2%)
Total tracing 10.609 s -
Total appsec 10.771 s 162.35 ms (1.5%)
Total iast 10.919 s 310.277 ms (2.9%)
Total profiling 10.971 s 362.056 ms (3.4%)
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (731.702 ms) : 0, 731702
BytebuddyAgent [candidate] (733.634 ms) : 0, 733634
GlobalTracer [baseline] (242.546 ms) : 0, 242546
GlobalTracer [candidate] (242.703 ms) : 0, 242703
AppSec [baseline] (30.571 ms) : 0, 30571
AppSec [candidate] (30.13 ms) : 0, 30130
Debugger [baseline] (6.509 ms) : 0, 6509
Debugger [candidate] (6.427 ms) : 0, 6427
Remote Config [baseline] (682.837 µs) : 0, 683
Remote Config [candidate] (672.875 µs) : 0, 673
Telemetry [baseline] (13.823 ms) : 0, 13823
Telemetry [candidate] (12.247 ms) : 0, 12247
section appsec
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (756.466 ms) : 0, 756466
BytebuddyAgent [candidate] (753.642 ms) : 0, 753642
GlobalTracer [baseline] (235.779 ms) : 0, 235779
GlobalTracer [candidate] (235.13 ms) : 0, 235130
IAST [baseline] (23.576 ms) : 0, 23576
IAST [candidate] (23.345 ms) : 0, 23345
AppSec [baseline] (171.106 ms) : 0, 171106
AppSec [candidate] (167.896 ms) : 0, 167896
Debugger [baseline] (6.896 ms) : 0, 6896
Debugger [candidate] (9.3 ms) : 0, 9300
Remote Config [baseline] (645.758 µs) : 0, 646
Remote Config [candidate] (622.977 µs) : 0, 623
Telemetry [baseline] (8.495 ms) : 0, 8495
Telemetry [candidate] (8.454 ms) : 0, 8454
section iast
crashtracking [baseline] (1.446 ms) : 0, 1446
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (851.886 ms) : 0, 851886
BytebuddyAgent [candidate] (850.29 ms) : 0, 850290
GlobalTracer [baseline] (232.925 ms) : 0, 232925
GlobalTracer [candidate] (233.181 ms) : 0, 233181
IAST [baseline] (30.22 ms) : 0, 30220
IAST [candidate] (31.929 ms) : 0, 31929
AppSec [baseline] (26.573 ms) : 0, 26573
AppSec [candidate] (25.112 ms) : 0, 25112
Debugger [baseline] (7.954 ms) : 0, 7954
Debugger [candidate] (7.087 ms) : 0, 7087
Remote Config [baseline] (615.783 µs) : 0, 616
Remote Config [candidate] (615.937 µs) : 0, 616
Telemetry [baseline] (8.472 ms) : 0, 8472
Telemetry [candidate] (8.418 ms) : 0, 8418
section profiling
crashtracking [baseline] (1.439 ms) : 0, 1439
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (768.372 ms) : 0, 768372
BytebuddyAgent [candidate] (766.782 ms) : 0, 766782
GlobalTracer [baseline] (224.33 ms) : 0, 224330
GlobalTracer [candidate] (224.612 ms) : 0, 224612
AppSec [baseline] (31.038 ms) : 0, 31038
AppSec [candidate] (30.949 ms) : 0, 30949
Debugger [baseline] (6.714 ms) : 0, 6714
Debugger [candidate] (7.516 ms) : 0, 7516
Remote Config [baseline] (761.829 µs) : 0, 762
Remote Config [candidate] (693.636 µs) : 0, 694
Telemetry [baseline] (16.648 ms) : 0, 16648
Telemetry [candidate] (15.817 ms) : 0, 15817
ProfilingAgent [baseline] (109.012 ms) : 0, 109012
ProfilingAgent [candidate] (108.681 ms) : 0, 108681
Profiling [baseline] (109.73 ms) : 0, 109730
Profiling [candidate] (109.415 ms) : 0, 109415

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vandonr/fix2
git_commit_date 1757594538 1757596037
git_commit_sha 2349c6ec12 d58f083a29
release_version 1.54.0-SNAPSHOT~2349c6ec12 1.54.0-SNAPSHOT~d58f083a29
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1757597618 1757597618
ci_job_id 1124498952 1124498952
ci_pipeline_id 76188153 76188153
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-qf5hwb1h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-qf5hwb1h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load worse
[+208.405µs; +455.737µs] or [+2.717%; +5.942%]
unstable
[-100.790op/s; +51.290op/s] or [-16.694%; +8.495%]
8.002ms 579.000op/s 7.670ms 603.750op/s
scenario:load:insecure-bank:profiling:high_load worse
[+231.441µs; +528.907µs] or [+2.724%; +6.225%]
unstable
[-93.972op/s; +47.847op/s] or [-17.220%; +8.768%]
8.876ms 522.656op/s 8.496ms 545.719op/s
scenario:load:petclinic:profiling:high_load worse
[+2.806ms; +3.787ms] or [+6.215%; +8.388%]
unstable
[-14.498op/s; +0.448op/s] or [-13.993%; +0.432%]
48.450ms 96.588op/s 45.153ms 103.612op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.452 ms) : 4400, 4504
.   : milestone, 4452,
iast (9.59 ms) : 9423, 9757
.   : milestone, 9590,
iast_FULL (14.242 ms) : 13956, 14527
.   : milestone, 14242,
iast_GLOBAL (10.43 ms) : 10247, 10613
.   : milestone, 10430,
profiling (8.496 ms) : 8357, 8636
.   : milestone, 8496,
tracing (7.67 ms) : 7554, 7785
.   : milestone, 7670,
section candidate
no_agent (4.388 ms) : 4333, 4443
.   : milestone, 4388,
iast (9.477 ms) : 9317, 9636
.   : milestone, 9477,
iast_FULL (13.856 ms) : 13580, 14132
.   : milestone, 13856,
iast_GLOBAL (10.265 ms) : 10085, 10445
.   : milestone, 10265,
profiling (8.876 ms) : 8740, 9013
.   : milestone, 8876,
tracing (8.002 ms) : 7887, 8116
.   : milestone, 8002,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.452 ms [4.4 ms, 4.504 ms] -
iast 9.59 ms [9.423 ms, 9.757 ms] 5.138 ms (115.4%)
iast_FULL 14.242 ms [13.956 ms, 14.527 ms] 9.79 ms (219.9%)
iast_GLOBAL 10.43 ms [10.247 ms, 10.613 ms] 5.978 ms (134.3%)
profiling 8.496 ms [8.357 ms, 8.636 ms] 4.044 ms (90.8%)
tracing 7.67 ms [7.554 ms, 7.785 ms] 3.218 ms (72.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.388 ms [4.333 ms, 4.443 ms] -
iast 9.477 ms [9.317 ms, 9.636 ms] 5.089 ms (116.0%)
iast_FULL 13.856 ms [13.58 ms, 14.132 ms] 9.468 ms (215.8%)
iast_GLOBAL 10.265 ms [10.085 ms, 10.445 ms] 5.877 ms (133.9%)
profiling 8.876 ms [8.74 ms, 9.013 ms] 4.488 ms (102.3%)
tracing 8.002 ms [7.887 ms, 8.116 ms] 3.613 ms (82.3%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12
    dateFormat X
    axisFormat %s
section baseline
no_agent (35.971 ms) : 35683, 36260
.   : milestone, 35971,
appsec (48.93 ms) : 48501, 49360
.   : milestone, 48930,
code_origins (46.01 ms) : 45621, 46399
.   : milestone, 46010,
iast (45.125 ms) : 44740, 45510
.   : milestone, 45125,
profiling (45.153 ms) : 44750, 45557
.   : milestone, 45153,
tracing (44.005 ms) : 43654, 44357
.   : milestone, 44005,
section candidate
no_agent (36.543 ms) : 36250, 36837
.   : milestone, 36543,
appsec (49.554 ms) : 49108, 49999
.   : milestone, 49554,
code_origins (46.528 ms) : 46135, 46922
.   : milestone, 46528,
iast (45.18 ms) : 44773, 45587
.   : milestone, 45180,
profiling (48.45 ms) : 47947, 48953
.   : milestone, 48450,
tracing (44.032 ms) : 43666, 44398
.   : milestone, 44032,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 35.971 ms [35.683 ms, 36.26 ms] -
appsec 48.93 ms [48.501 ms, 49.36 ms] 12.959 ms (36.0%)
code_origins 46.01 ms [45.621 ms, 46.399 ms] 10.039 ms (27.9%)
iast 45.125 ms [44.74 ms, 45.51 ms] 9.154 ms (25.4%)
profiling 45.153 ms [44.75 ms, 45.557 ms] 9.182 ms (25.5%)
tracing 44.005 ms [43.654 ms, 44.357 ms] 8.034 ms (22.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.543 ms [36.25 ms, 36.837 ms] -
appsec 49.554 ms [49.108 ms, 49.999 ms] 13.01 ms (35.6%)
code_origins 46.528 ms [46.135 ms, 46.922 ms] 9.985 ms (27.3%)
iast 45.18 ms [44.773 ms, 45.587 ms] 8.637 ms (23.6%)
profiling 48.45 ms [47.947 ms, 48.953 ms] 11.907 ms (32.6%)
tracing 44.032 ms [43.666 ms, 44.398 ms] 7.489 ms (20.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vandonr/fix2
git_commit_date 1757594538 1757596037
git_commit_sha 2349c6ec12 d58f083a29
release_version 1.54.0-SNAPSHOT~2349c6ec12 1.54.0-SNAPSHOT~d58f083a29
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1757598144 1757598144
ci_job_id 1124498954 1124498954
ci_pipeline_id 76188153 76188153
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-xfxdxb2x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-xfxdxb2x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.719 ms) : 3503, 3936
.   : milestone, 3719,
iast (2.209 ms) : 2147, 2271
.   : milestone, 2209,
iast_GLOBAL (2.24 ms) : 2177, 2303
.   : milestone, 2240,
profiling (2.072 ms) : 2020, 2124
.   : milestone, 2072,
tracing (2.025 ms) : 1977, 2073
.   : milestone, 2025,
section candidate
no_agent (1.477 ms) : 1465, 1489
.   : milestone, 1477,
appsec (3.59 ms) : 3379, 3802
.   : milestone, 3590,
iast (2.186 ms) : 2123, 2248
.   : milestone, 2186,
iast_GLOBAL (2.262 ms) : 2198, 2325
.   : milestone, 2262,
profiling (2.052 ms) : 2001, 2102
.   : milestone, 2052,
tracing (2.014 ms) : 1966, 2062
.   : milestone, 2014,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 3.719 ms [3.503 ms, 3.936 ms] 2.243 ms (151.9%)
iast 2.209 ms [2.147 ms, 2.271 ms] 732.932 µs (49.6%)
iast_GLOBAL 2.24 ms [2.177 ms, 2.303 ms] 763.778 µs (51.7%)
profiling 2.072 ms [2.02 ms, 2.124 ms] 595.779 µs (40.4%)
tracing 2.025 ms [1.977 ms, 2.073 ms] 548.834 µs (37.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.489 ms] -
appsec 3.59 ms [3.379 ms, 3.802 ms] 2.113 ms (143.1%)
iast 2.186 ms [2.123 ms, 2.248 ms] 708.646 µs (48.0%)
iast_GLOBAL 2.262 ms [2.198 ms, 2.325 ms] 784.717 µs (53.1%)
profiling 2.052 ms [2.001 ms, 2.102 ms] 574.63 µs (38.9%)
tracing 2.014 ms [1.966 ms, 2.062 ms] 536.665 µs (36.3%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.326 s) : 15326000, 15326000
.   : milestone, 15326000,
appsec (15.02 s) : 15020000, 15020000
.   : milestone, 15020000,
iast (19.073 s) : 19073000, 19073000
.   : milestone, 19073000,
iast_GLOBAL (18.114 s) : 18114000, 18114000
.   : milestone, 18114000,
profiling (15.388 s) : 15388000, 15388000
.   : milestone, 15388000,
tracing (15.059 s) : 15059000, 15059000
.   : milestone, 15059000,
section candidate
no_agent (15.326 s) : 15326000, 15326000
.   : milestone, 15326000,
appsec (15.002 s) : 15002000, 15002000
.   : milestone, 15002000,
iast (18.895 s) : 18895000, 18895000
.   : milestone, 18895000,
iast_GLOBAL (18.304 s) : 18304000, 18304000
.   : milestone, 18304000,
profiling (15.569 s) : 15569000, 15569000
.   : milestone, 15569000,
tracing (15.103 s) : 15103000, 15103000
.   : milestone, 15103000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.326 s [15.326 s, 15.326 s] -
appsec 15.02 s [15.02 s, 15.02 s] -306.0 ms (-2.0%)
iast 19.073 s [19.073 s, 19.073 s] 3.747 s (24.4%)
iast_GLOBAL 18.114 s [18.114 s, 18.114 s] 2.788 s (18.2%)
profiling 15.388 s [15.388 s, 15.388 s] 62.0 ms (0.4%)
tracing 15.059 s [15.059 s, 15.059 s] -267.0 ms (-1.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.326 s [15.326 s, 15.326 s] -
appsec 15.002 s [15.002 s, 15.002 s] -324.0 ms (-2.1%)
iast 18.895 s [18.895 s, 18.895 s] 3.569 s (23.3%)
iast_GLOBAL 18.304 s [18.304 s, 18.304 s] 2.978 s (19.4%)
profiling 15.569 s [15.569 s, 15.569 s] 243.0 ms (1.6%)
tracing 15.103 s [15.103 s, 15.103 s] -223.0 ms (-1.5%)

pr-commenter[bot] avatar Sep 10 '25 09:09 pr-commenter[bot]