dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

Published 20 hours ago • verified publisher icon DataDog

Fix Gradle version locking

Open PerfectSlayer opened this issue 1 year ago • 1 comments

What Does This Do

This PR moves the version locking into a Gradle convention plugin as subprojects and allprojects must be avoid for shared project configuration. It also updates the pinned version before building nightly versions.

Motivation

Version locking was broken. Nightly build does no more test latest library versions.

Additional Notes

Not sure about the CI script update... Can it mess with the cache?

Jira ticket: [PROJ-IDENT]

PerfectSlayer avatar Jun 25 '24 15:06 PerfectSlayer

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/lib-catalog
git_commit_date 1719309238 1719330483
git_commit_sha d19ceac03e 7cea4dc426
release_version 1.36.0-SNAPSHOT~d19ceac03e 1.36.0-SNAPSHOT~7cea4dc426
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1719333863 1719333863
ci_job_id 552858389 552858389
ci_pipeline_id 37519194 37519194
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~7cea4dc426, baseline=1.36.0-SNAPSHOT~d19ceac03e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058999
Total [baseline] (10.355 s) : 0, 10355385
Agent [candidate] (1.069 s) : 0, 1068883
Total [candidate] (10.355 s) : 0, 10355242
section appsec
Agent [baseline] (1.184 s) : 0, 1184312
Total [baseline] (10.444 s) : 0, 10444092
Agent [candidate] (1.183 s) : 0, 1182668
Total [candidate] (10.49 s) : 0, 10489659
section iast
Agent [baseline] (1.177 s) : 0, 1177201
Total [baseline] (10.671 s) : 0, 10670746
Agent [candidate] (1.185 s) : 0, 1184589
Total [candidate] (10.78 s) : 0, 10779853
section profiling
Agent [baseline] (1.259 s) : 0, 1258545
Total [baseline] (10.666 s) : 0, 10666061
Agent [candidate] (1.259 s) : 0, 1258956
Total [candidate] (10.585 s) : 0, 10584728
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.184 s 125.313 ms (11.8%)
Agent iast 1.177 s 118.202 ms (11.2%)
Agent profiling 1.259 s 199.546 ms (18.8%)
Total tracing 10.355 s -
Total appsec 10.444 s 88.707 ms (0.9%)
Total iast 10.671 s 315.361 ms (3.0%)
Total profiling 10.666 s 310.675 ms (3.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent appsec 1.183 s 113.784 ms (10.6%)
Agent iast 1.185 s 115.706 ms (10.8%)
Agent profiling 1.259 s 190.072 ms (17.8%)
Total tracing 10.355 s -
Total appsec 10.49 s 134.417 ms (1.3%)
Total iast 10.78 s 424.611 ms (4.1%)
Total profiling 10.585 s 229.486 ms (2.2%) 
gantt
    title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~7cea4dc426, baseline=1.36.0-SNAPSHOT~d19ceac03e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (663.787 ms) : 0, 663787
BytebuddyAgent [candidate] (670.089 ms) : 0, 670089
GlobalTracer [baseline] (302.673 ms) : 0, 302673
GlobalTracer [candidate] (305.517 ms) : 0, 305517
AppSec [baseline] (50.024 ms) : 0, 50024
AppSec [candidate] (50.421 ms) : 0, 50421
Remote Config [baseline] (688.229 µs) : 0, 688
Remote Config [candidate] (690.779 µs) : 0, 691
Telemetry [baseline] (7.61 ms) : 0, 7610
Telemetry [candidate] (7.625 ms) : 0, 7625
section appsec
BytebuddyAgent [baseline] (676.621 ms) : 0, 676621
BytebuddyAgent [candidate] (677.432 ms) : 0, 677432
GlobalTracer [baseline] (298.495 ms) : 0, 298495
GlobalTracer [candidate] (297.021 ms) : 0, 297021
AppSec [baseline] (154.167 ms) : 0, 154167
AppSec [candidate] (154.191 ms) : 0, 154191
IAST [baseline] (22.344 ms) : 0, 22344
IAST [candidate] (20.543 ms) : 0, 20543
Remote Config [baseline] (639.579 µs) : 0, 640
Remote Config [candidate] (635.778 µs) : 0, 636
Telemetry [baseline] (8.829 ms) : 0, 8829
Telemetry [candidate] (8.504 ms) : 0, 8504
section iast
BytebuddyAgent [baseline] (785.554 ms) : 0, 785554
BytebuddyAgent [candidate] (789.71 ms) : 0, 789710
GlobalTracer [baseline] (295.098 ms) : 0, 295098
GlobalTracer [candidate] (296.807 ms) : 0, 296807
AppSec [baseline] (47.404 ms) : 0, 47404
AppSec [candidate] (47.825 ms) : 0, 47825
IAST [baseline] (28.29 ms) : 0, 28290
IAST [candidate] (29.046 ms) : 0, 29046
Remote Config [baseline] (607.573 µs) : 0, 608
Remote Config [candidate] (631.899 µs) : 0, 632
Telemetry [baseline] (6.871 ms) : 0, 6871
Telemetry [candidate] (7.125 ms) : 0, 7125
section profiling
BytebuddyAgent [baseline] (660.644 ms) : 0, 660644
BytebuddyAgent [candidate] (661.208 ms) : 0, 661208
GlobalTracer [baseline] (385.772 ms) : 0, 385772
GlobalTracer [candidate] (385.39 ms) : 0, 385390
AppSec [baseline] (51.367 ms) : 0, 51367
AppSec [candidate] (51.286 ms) : 0, 51286
Remote Config [baseline] (742.166 µs) : 0, 742
Remote Config [candidate] (747.544 µs) : 0, 748
Telemetry [baseline] (7.335 ms) : 0, 7335
Telemetry [candidate] (7.369 ms) : 0, 7369
ProfilingAgent [baseline] (96.007 ms) : 0, 96007
ProfilingAgent [candidate] (96.131 ms) : 0, 96131
Profiling [baseline] (96.031 ms) : 0, 96031
Profiling [candidate] (96.155 ms) : 0, 96155
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~7cea4dc426, baseline=1.36.0-SNAPSHOT~d19ceac03e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1065401
Total [baseline] (8.546 s) : 0, 8545873
Agent [candidate] (1.059 s) : 0, 1058992
Total [candidate] (8.575 s) : 0, 8575243
section iast
Agent [baseline] (1.167 s) : 0, 1167427
Total [baseline] (8.98 s) : 0, 8979695
Agent [candidate] (1.169 s) : 0, 1169077
Total [candidate] (8.991 s) : 0, 8990935
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.169 s) : 0, 1169209
Total [baseline] (9.021 s) : 0, 9021435
Agent [candidate] (1.167 s) : 0, 1167364
Total [candidate] (8.951 s) : 0, 8950912
section iast_TELEMETRY_OFF
Agent [baseline] (1.166 s) : 0, 1165981
Total [baseline] (8.968 s) : 0, 8967549
Agent [candidate] (1.173 s) : 0, 1173081
Total [candidate] (9.002 s) : 0, 9002393
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent iast 1.167 s 102.026 ms (9.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.169 s 103.808 ms (9.7%)
Agent iast_TELEMETRY_OFF 1.166 s 100.58 ms (9.4%)
Total tracing 8.546 s -
Total iast 8.98 s 433.822 ms (5.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.021 s 475.562 ms (5.6%)
Total iast_TELEMETRY_OFF 8.968 s 421.676 ms (4.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.169 s 110.085 ms (10.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.167 s 108.371 ms (10.2%)
Agent iast_TELEMETRY_OFF 1.173 s 114.089 ms (10.8%)
Total tracing 8.575 s -
Total iast 8.991 s 415.691 ms (4.8%)
Total iast_HARDCODED_SECRET_DISABLED 8.951 s 375.668 ms (4.4%)
Total iast_TELEMETRY_OFF 9.002 s 427.15 ms (5.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~7cea4dc426, baseline=1.36.0-SNAPSHOT~d19ceac03e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (667.965 ms) : 0, 667965
BytebuddyAgent [candidate] (663.764 ms) : 0, 663764
GlobalTracer [baseline] (304.331 ms) : 0, 304331
GlobalTracer [candidate] (302.586 ms) : 0, 302586
AppSec [baseline] (50.377 ms) : 0, 50377
AppSec [candidate] (50.098 ms) : 0, 50098
Remote Config [baseline] (690.038 µs) : 0, 690
Remote Config [candidate] (688.1 µs) : 0, 688
Telemetry [baseline] (7.569 ms) : 0, 7569
Telemetry [candidate] (7.579 ms) : 0, 7579
section iast
BytebuddyAgent [baseline] (778.412 ms) : 0, 778412
BytebuddyAgent [candidate] (779.329 ms) : 0, 779329
GlobalTracer [baseline] (292.474 ms) : 0, 292474
GlobalTracer [candidate] (292.983 ms) : 0, 292983
AppSec [baseline] (46.955 ms) : 0, 46955
AppSec [candidate] (46.972 ms) : 0, 46972
IAST [baseline] (28.109 ms) : 0, 28109
IAST [candidate] (28.21 ms) : 0, 28210
Remote Config [baseline] (603.024 µs) : 0, 603
Remote Config [candidate] (640.737 µs) : 0, 641
Telemetry [baseline] (7.631 ms) : 0, 7631
Telemetry [candidate] (7.663 ms) : 0, 7663
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (779.197 ms) : 0, 779197
BytebuddyAgent [candidate] (777.398 ms) : 0, 777398
GlobalTracer [baseline] (293.239 ms) : 0, 293239
GlobalTracer [candidate] (292.865 ms) : 0, 292865
AppSec [baseline] (47.27 ms) : 0, 47270
AppSec [candidate] (47.041 ms) : 0, 47041
IAST [baseline] (27.869 ms) : 0, 27869
IAST [candidate] (28.437 ms) : 0, 28437
Remote Config [baseline] (630.764 µs) : 0, 631
Remote Config [candidate] (633.654 µs) : 0, 634
Telemetry [baseline] (7.664 ms) : 0, 7664
Telemetry [candidate] (7.685 ms) : 0, 7685
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (776.247 ms) : 0, 776247
BytebuddyAgent [candidate] (781.575 ms) : 0, 781575
GlobalTracer [baseline] (293.852 ms) : 0, 293852
GlobalTracer [candidate] (294.702 ms) : 0, 294702
AppSec [baseline] (47.251 ms) : 0, 47251
AppSec [candidate] (47.496 ms) : 0, 47496
IAST [baseline] (25.639 ms) : 0, 25639
IAST [candidate] (26.801 ms) : 0, 26801
Remote Config [baseline] (614.984 µs) : 0, 615
Remote Config [candidate] (598.188 µs) : 0, 598
Telemetry [baseline] (9.092 ms) : 0, 9092
Telemetry [candidate] (8.471 ms) : 0, 8471

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-25T16:13:59 2024-06-25T16:20:52
git_branch master bbujon/lib-catalog
git_commit_date 1719309238 1719330483
git_commit_sha d19ceac03e 7cea4dc426
release_version 1.36.0-SNAPSHOT~d19ceac03e 1.36.0-SNAPSHOT~7cea4dc426
start_time 2024-06-25T16:13:46 2024-06-25T16:20:38
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1719332799 1719332799
ci_job_id 552858390 552858390
ci_pipeline_id 37519194 37519194
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~7cea4dc426, baseline=1.36.0-SNAPSHOT~d19ceac03e
    dateFormat X
    axisFormat %s
section baseline
no_agent (383.914 µs) : 364, 404
.   : milestone, 384,
iast (486.257 µs) : 465, 508
.   : milestone, 486,
iast_FULL (560.245 µs) : 539, 581
.   : milestone, 560,
iast_GLOBAL (508.345 µs) : 487, 530
.   : milestone, 508,
iast_HARDCODED_SECRET_DISABLED (493.64 µs) : 472, 515
.   : milestone, 494,
iast_INACTIVE (464.495 µs) : 443, 486
.   : milestone, 464,
iast_TELEMETRY_OFF (479.991 µs) : 458, 502
.   : milestone, 480,
tracing (444.354 µs) : 423, 465
.   : milestone, 444,
section candidate
no_agent (375.323 µs) : 356, 395
.   : milestone, 375,
iast (485.38 µs) : 464, 506
.   : milestone, 485,
iast_FULL (554.616 µs) : 533, 576
.   : milestone, 555,
iast_GLOBAL (518.397 µs) : 496, 541
.   : milestone, 518,
iast_HARDCODED_SECRET_DISABLED (486.614 µs) : 465, 508
.   : milestone, 487,
iast_INACTIVE (449.55 µs) : 429, 470
.   : milestone, 450,
iast_TELEMETRY_OFF (477.862 µs) : 457, 499
.   : milestone, 478,
tracing (446.853 µs) : 426, 468
.   : milestone, 447,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 383.914 µs [363.876 µs, 403.953 µs] -
iast 486.257 µs [464.629 µs, 507.884 µs] 102.342 µs (26.7%)
iast_FULL 560.245 µs [539.02 µs, 581.469 µs] 176.33 µs (45.9%)
iast_GLOBAL 508.345 µs [487.155 µs, 529.535 µs] 124.43 µs (32.4%)
iast_HARDCODED_SECRET_DISABLED 493.64 µs [472.062 µs, 515.217 µs] 109.725 µs (28.6%)
iast_INACTIVE 464.495 µs [443.034 µs, 485.957 µs] 80.581 µs (21.0%)
iast_TELEMETRY_OFF 479.991 µs [457.734 µs, 502.248 µs] 96.077 µs (25.0%)
tracing 444.354 µs [423.384 µs, 465.323 µs] 60.439 µs (15.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 375.323 µs [355.687 µs, 394.958 µs] -
iast 485.38 µs [464.399 µs, 506.361 µs] 110.057 µs (29.3%)
iast_FULL 554.616 µs [533.425 µs, 575.808 µs] 179.294 µs (47.8%)
iast_GLOBAL 518.397 µs [496.19 µs, 540.603 µs] 143.074 µs (38.1%)
iast_HARDCODED_SECRET_DISABLED 486.614 µs [465.417 µs, 507.812 µs] 111.292 µs (29.7%)
iast_INACTIVE 449.55 µs [428.631 µs, 470.468 µs] 74.227 µs (19.8%)
iast_TELEMETRY_OFF 477.862 µs [456.791 µs, 498.933 µs] 102.539 µs (27.3%)
tracing 446.853 µs [426.164 µs, 467.542 µs] 71.53 µs (19.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~7cea4dc426, baseline=1.36.0-SNAPSHOT~d19ceac03e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.349 ms) : 1330, 1369
.   : milestone, 1349,
appsec (1.746 ms) : 1722, 1769
.   : milestone, 1746,
appsec_no_iast (1.724 ms) : 1699, 1749
.   : milestone, 1724,
iast (1.488 ms) : 1466, 1510
.   : milestone, 1488,
profiling (1.544 ms) : 1519, 1570
.   : milestone, 1544,
tracing (1.491 ms) : 1467, 1516
.   : milestone, 1491,
section candidate
no_agent (1.36 ms) : 1340, 1380
.   : milestone, 1360,
appsec (1.711 ms) : 1686, 1735
.   : milestone, 1711,
appsec_no_iast (1.721 ms) : 1695, 1746
.   : milestone, 1721,
iast (1.497 ms) : 1474, 1519
.   : milestone, 1497,
profiling (1.565 ms) : 1540, 1589
.   : milestone, 1565,
tracing (1.484 ms) : 1460, 1508
.   : milestone, 1484,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.349 ms [1.33 ms, 1.369 ms] -
appsec 1.746 ms [1.722 ms, 1.769 ms] 396.438 µs (29.4%)
appsec_no_iast 1.724 ms [1.699 ms, 1.749 ms] 374.884 µs (27.8%)
iast 1.488 ms [1.466 ms, 1.51 ms] 138.512 µs (10.3%)
profiling 1.544 ms [1.519 ms, 1.57 ms] 195.158 µs (14.5%)
tracing 1.491 ms [1.467 ms, 1.516 ms] 142.063 µs (10.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.36 ms [1.34 ms, 1.38 ms] -
appsec 1.711 ms [1.686 ms, 1.735 ms] 350.73 µs (25.8%)
appsec_no_iast 1.721 ms [1.695 ms, 1.746 ms] 361.011 µs (26.5%)
iast 1.497 ms [1.474 ms, 1.519 ms] 136.913 µs (10.1%)
profiling 1.565 ms [1.54 ms, 1.589 ms] 204.836 µs (15.1%)
tracing 1.484 ms [1.46 ms, 1.508 ms] 124.128 µs (9.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/lib-catalog
git_commit_date 1719309238 1719330483
git_commit_sha d19ceac03e 7cea4dc426
release_version 1.36.0-SNAPSHOT~d19ceac03e 1.36.0-SNAPSHOT~7cea4dc426
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1719333302 1719333302
ci_job_id 552858391 552858391
ci_pipeline_id 37519194 37519194
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~7cea4dc426, baseline=1.36.0-SNAPSHOT~d19ceac03e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.401 s) : 15401000, 15401000
.   : milestone, 15401000,
appsec (14.997 s) : 14997000, 14997000
.   : milestone, 14997000,
iast (18.817 s) : 18817000, 18817000
.   : milestone, 18817000,
iast_GLOBAL (17.635 s) : 17635000, 17635000
.   : milestone, 17635000,
profiling (15.273 s) : 15273000, 15273000
.   : milestone, 15273000,
tracing (15.13 s) : 15130000, 15130000
.   : milestone, 15130000,
section candidate
no_agent (15.086 s) : 15086000, 15086000
.   : milestone, 15086000,
appsec (14.993 s) : 14993000, 14993000
.   : milestone, 14993000,
iast (19.092 s) : 19092000, 19092000
.   : milestone, 19092000,
iast_GLOBAL (19.102 s) : 19102000, 19102000
.   : milestone, 19102000,
profiling (14.859 s) : 14859000, 14859000
.   : milestone, 14859000,
tracing (15.009 s) : 15009000, 15009000
.   : milestone, 15009000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.401 s [15.401 s, 15.401 s] -
appsec 14.997 s [14.997 s, 14.997 s] -404.0 ms (-2.6%)
iast 18.817 s [18.817 s, 18.817 s] 3.416 s (22.2%)
iast_GLOBAL 17.635 s [17.635 s, 17.635 s] 2.234 s (14.5%)
profiling 15.273 s [15.273 s, 15.273 s] -128.0 ms (-0.8%)
tracing 15.13 s [15.13 s, 15.13 s] -271.0 ms (-1.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.086 s [15.086 s, 15.086 s] -
appsec 14.993 s [14.993 s, 14.993 s] -93.0 ms (-0.6%)
iast 19.092 s [19.092 s, 19.092 s] 4.006 s (26.6%)
iast_GLOBAL 19.102 s [19.102 s, 19.102 s] 4.016 s (26.6%)
profiling 14.859 s [14.859 s, 14.859 s] -227.0 ms (-1.5%)
tracing 15.009 s [15.009 s, 15.009 s] -77.0 ms (-0.5%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~7cea4dc426, baseline=1.36.0-SNAPSHOT~d19ceac03e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.46 ms) : 1448, 1471
.   : milestone, 1460,
appsec (2.192 ms) : 2158, 2225
.   : milestone, 2192,
iast (1.96 ms) : 1919, 2002
.   : milestone, 1960,
iast_GLOBAL (1.998 ms) : 1957, 2039
.   : milestone, 1998,
profiling (2.317 ms) : 2137, 2497
.   : milestone, 2317,
tracing (1.828 ms) : 1796, 1861
.   : milestone, 1828,
section candidate
no_agent (1.456 ms) : 1444, 1467
.   : milestone, 1456,
appsec (2.195 ms) : 2161, 2229
.   : milestone, 2195,
iast (1.964 ms) : 1922, 2005
.   : milestone, 1964,
iast_GLOBAL (1.995 ms) : 1954, 2036
.   : milestone, 1995,
profiling (1.846 ms) : 1811, 1880
.   : milestone, 1846,
tracing (1.83 ms) : 1797, 1862
.   : milestone, 1830,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.46 ms [1.448 ms, 1.471 ms] -
appsec 2.192 ms [2.158 ms, 2.225 ms] 731.863 µs (50.1%)
iast 1.96 ms [1.919 ms, 2.002 ms] 500.835 µs (34.3%)
iast_GLOBAL 1.998 ms [1.957 ms, 2.039 ms] 538.282 µs (36.9%)
profiling 2.317 ms [2.137 ms, 2.497 ms] 857.289 µs (58.7%)
tracing 1.828 ms [1.796 ms, 1.861 ms] 368.729 µs (25.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.456 ms [1.444 ms, 1.467 ms] -
appsec 2.195 ms [2.161 ms, 2.229 ms] 739.212 µs (50.8%)
iast 1.964 ms [1.922 ms, 2.005 ms] 507.914 µs (34.9%)
iast_GLOBAL 1.995 ms [1.954 ms, 2.036 ms] 539.332 µs (37.0%)
profiling 1.846 ms [1.811 ms, 1.88 ms] 389.977 µs (26.8%)
tracing 1.83 ms [1.797 ms, 1.862 ms] 373.951 µs (25.7%)

pr-commenter[bot] avatar Jun 25 '24 16:06 pr-commenter[bot]