dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

Published 20 hours ago • verified publisher icon DataDog

Use unified Gitlab pipeline (WIP)

Open randomanderson opened this issue 1 year ago • 1 comments
trafficstars

What Does This Do

Motivation

Additional Notes

Jira ticket: [PROJ-IDENT]

randomanderson avatar Jun 10 '24 15:06 randomanderson

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/one-pipeline
git_commit_date 1721393191 1721407163
git_commit_sha bf41350429 9f1b9fa617
release_version 1.38.0-SNAPSHOT~bf41350429 1.38.0-SNAPSHOT~9f1b9fa617
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1721409564 1721409564
ci_job_id 578810273 578810273
ci_pipeline_id 39674390 39674390
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 9 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.38.0-SNAPSHOT~9f1b9fa617, baseline=1.38.0-SNAPSHOT~bf41350429

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1051916
Total [baseline] (10.369 s) : 0, 10368878
Agent [candidate] (1.058 s) : 0, 1057607
Total [candidate] (10.401 s) : 0, 10400824
section appsec
Agent [baseline] (1.166 s) : 0, 1165674
Total [baseline] (10.44 s) : 0, 10439681
Agent [candidate] (1.165 s) : 0, 1165025
Total [candidate] (10.461 s) : 0, 10460844
section iast
Agent [baseline] (1.168 s) : 0, 1168084
Total [baseline] (10.686 s) : 0, 10686075
Agent [candidate] (1.175 s) : 0, 1174882
Total [candidate] (10.723 s) : 0, 10722629
section profiling
Agent [baseline] (1.251 s) : 0, 1251352
Total [baseline] (10.578 s) : 0, 10577799
Agent [candidate] (1.26 s) : 0, 1259528
Total [candidate] (10.648 s) : 0, 10648060
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.166 s 113.758 ms (10.8%)
Agent iast 1.168 s 116.168 ms (11.0%)
Agent profiling 1.251 s 199.436 ms (19.0%)
Total tracing 10.369 s -
Total appsec 10.44 s 70.804 ms (0.7%)
Total iast 10.686 s 317.197 ms (3.1%)
Total profiling 10.578 s 208.921 ms (2.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.165 s 107.418 ms (10.2%)
Agent iast 1.175 s 117.274 ms (11.1%)
Agent profiling 1.26 s 201.921 ms (19.1%)
Total tracing 10.401 s -
Total appsec 10.461 s 60.019 ms (0.6%)
Total iast 10.723 s 321.805 ms (3.1%)
Total profiling 10.648 s 247.236 ms (2.4%) 
gantt
    title petclinic - break down per module: candidate=1.38.0-SNAPSHOT~9f1b9fa617, baseline=1.38.0-SNAPSHOT~bf41350429

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (671.875 ms) : 0, 671875
BytebuddyAgent [candidate] (676.349 ms) : 0, 676349
GlobalTracer [baseline] (307.716 ms) : 0, 307716
GlobalTracer [candidate] (308.733 ms) : 0, 308733
AppSec [baseline] (50.515 ms) : 0, 50515
AppSec [candidate] (50.506 ms) : 0, 50506
Remote Config [baseline] (665.566 µs) : 0, 666
Remote Config [candidate] (679.241 µs) : 0, 679
Telemetry [baseline] (7.577 ms) : 0, 7577
Telemetry [candidate] (7.683 ms) : 0, 7683
section appsec
BytebuddyAgent [baseline] (678.159 ms) : 0, 678159
BytebuddyAgent [candidate] (677.282 ms) : 0, 677282
GlobalTracer [baseline] (299.733 ms) : 0, 299733
GlobalTracer [candidate] (299.636 ms) : 0, 299636
AppSec [baseline] (153.993 ms) : 0, 153993
AppSec [candidate] (153.908 ms) : 0, 153908
Remote Config [baseline] (625.351 µs) : 0, 625
Remote Config [candidate] (624.51 µs) : 0, 625
Telemetry [baseline] (7.909 ms) : 0, 7909
Telemetry [candidate] (8.878 ms) : 0, 8878
IAST [baseline] (23.442 ms) : 0, 23442
IAST [candidate] (22.44 ms) : 0, 22440
section iast
BytebuddyAgent [baseline] (778.657 ms) : 0, 778657
BytebuddyAgent [candidate] (780.885 ms) : 0, 780885
GlobalTracer [baseline] (295.152 ms) : 0, 295152
GlobalTracer [candidate] (297.923 ms) : 0, 297923
AppSec [baseline] (47.096 ms) : 0, 47096
AppSec [candidate] (48.44 ms) : 0, 48440
Remote Config [baseline] (579.575 µs) : 0, 580
Remote Config [candidate] (594.164 µs) : 0, 594
Telemetry [baseline] (6.966 ms) : 0, 6966
Telemetry [candidate] (7.855 ms) : 0, 7855
IAST [baseline] (26.206 ms) : 0, 26206
IAST [candidate] (25.704 ms) : 0, 25704
section profiling
ProfilingAgent [baseline] (95.749 ms) : 0, 95749
ProfilingAgent [candidate] (96.263 ms) : 0, 96263
BytebuddyAgent [baseline] (668.376 ms) : 0, 668376
BytebuddyAgent [candidate] (673.331 ms) : 0, 673331
GlobalTracer [baseline] (390.545 ms) : 0, 390545
GlobalTracer [candidate] (393.157 ms) : 0, 393157
AppSec [baseline] (52.205 ms) : 0, 52205
AppSec [candidate] (52.043 ms) : 0, 52043
Remote Config [baseline] (661.867 µs) : 0, 662
Remote Config [candidate] (673.697 µs) : 0, 674
Telemetry [baseline] (7.509 ms) : 0, 7509
Telemetry [candidate] (7.468 ms) : 0, 7468
Profiling [baseline] (95.773 ms) : 0, 95773
Profiling [candidate] (96.288 ms) : 0, 96288
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.38.0-SNAPSHOT~9f1b9fa617, baseline=1.38.0-SNAPSHOT~bf41350429

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1049301
Total [baseline] (8.481 s) : 0, 8481052
Agent [candidate] (1.04 s) : 0, 1040334
Total [candidate] (8.455 s) : 0, 8455075
section iast
Agent [baseline] (1.187 s) : 0, 1186953
Total [baseline] (8.978 s) : 0, 8977849
Agent [candidate] (1.177 s) : 0, 1177143
Total [candidate] (8.972 s) : 0, 8971633
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.179 s) : 0, 1178767
Total [baseline] (8.936 s) : 0, 8935981
Agent [candidate] (1.169 s) : 0, 1169146
Total [candidate] (8.949 s) : 0, 8949275
section iast_TELEMETRY_OFF
Agent [baseline] (1.182 s) : 0, 1182312
Total [baseline] (8.99 s) : 0, 8990428
Agent [candidate] (1.165 s) : 0, 1165139
Total [candidate] (8.935 s) : 0, 8934573
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.187 s 137.652 ms (13.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.179 s 129.466 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.182 s 133.011 ms (12.7%)
Total tracing 8.481 s -
Total iast 8.978 s 496.797 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 8.936 s 454.929 ms (5.4%)
Total iast_TELEMETRY_OFF 8.99 s 509.376 ms (6.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent iast 1.177 s 136.809 ms (13.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.169 s 128.812 ms (12.4%)
Agent iast_TELEMETRY_OFF 1.165 s 124.805 ms (12.0%)
Total tracing 8.455 s -
Total iast 8.972 s 516.558 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 8.949 s 494.2 ms (5.8%)
Total iast_TELEMETRY_OFF 8.935 s 479.498 ms (5.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.38.0-SNAPSHOT~9f1b9fa617, baseline=1.38.0-SNAPSHOT~bf41350429

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.09 ms) : 0, 670090
BytebuddyAgent [candidate] (664.167 ms) : 0, 664167
GlobalTracer [baseline] (307.077 ms) : 0, 307077
GlobalTracer [candidate] (304.346 ms) : 0, 304346
AppSec [baseline] (50.311 ms) : 0, 50311
AppSec [candidate] (50.172 ms) : 0, 50172
Remote Config [baseline] (672.526 µs) : 0, 673
Remote Config [candidate] (666.811 µs) : 0, 667
Telemetry [baseline] (7.664 ms) : 0, 7664
Telemetry [candidate] (7.578 ms) : 0, 7578
section iast
BytebuddyAgent [baseline] (791.097 ms) : 0, 791097
BytebuddyAgent [candidate] (785.986 ms) : 0, 785986
GlobalTracer [baseline] (298.687 ms) : 0, 298687
GlobalTracer [candidate] (296.634 ms) : 0, 296634
AppSec [baseline] (47.742 ms) : 0, 47742
AppSec [candidate] (48.384 ms) : 0, 48384
IAST [baseline] (28.173 ms) : 0, 28173
IAST [candidate] (24.999 ms) : 0, 24999
Remote Config [baseline] (588.64 µs) : 0, 589
Remote Config [candidate] (595.327 µs) : 0, 595
Telemetry [baseline] (7.075 ms) : 0, 7075
Telemetry [candidate] (7.054 ms) : 0, 7054
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (786.104 ms) : 0, 786104
BytebuddyAgent [candidate] (778.616 ms) : 0, 778616
GlobalTracer [baseline] (296.752 ms) : 0, 296752
GlobalTracer [candidate] (294.485 ms) : 0, 294485
AppSec [baseline] (51.325 ms) : 0, 51325
AppSec [candidate] (50.164 ms) : 0, 50164
IAST [baseline] (23.413 ms) : 0, 23413
IAST [candidate] (24.95 ms) : 0, 24950
Remote Config [baseline] (585.24 µs) : 0, 585
Remote Config [candidate] (571.202 µs) : 0, 571
Telemetry [baseline] (7.013 ms) : 0, 7013
Telemetry [candidate] (6.872 ms) : 0, 6872
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (789.087 ms) : 0, 789087
BytebuddyAgent [candidate] (775.516 ms) : 0, 775516
GlobalTracer [baseline] (298.603 ms) : 0, 298603
GlobalTracer [candidate] (294.396 ms) : 0, 294396
AppSec [baseline] (47.653 ms) : 0, 47653
AppSec [candidate] (47.223 ms) : 0, 47223
IAST [baseline] (25.762 ms) : 0, 25762
IAST [candidate] (27.049 ms) : 0, 27049
Remote Config [baseline] (588.575 µs) : 0, 589
Remote Config [candidate] (576.311 µs) : 0, 576
Telemetry [baseline] (6.964 ms) : 0, 6964
Telemetry [candidate] (6.891 ms) : 0, 6891

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-07-19T16:52:08 2024-07-19T16:58:56
git_branch master landerson/one-pipeline
git_commit_date 1721393191 1721407163
git_commit_sha bf41350429 9f1b9fa617
release_version 1.38.0-SNAPSHOT~bf41350429 1.38.0-SNAPSHOT~9f1b9fa617
start_time 2024-07-19T16:51:55 2024-07-19T16:58:43
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1721408682 1721408682
ci_job_id 578810274 578810274
ci_pipeline_id 39674390 39674390
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~9f1b9fa617, baseline=1.38.0-SNAPSHOT~bf41350429
    dateFormat X
    axisFormat %s
section baseline
no_agent (369.75 µs) : 348, 392
.   : milestone, 370,
iast (476.569 µs) : 456, 497
.   : milestone, 477,
iast_FULL (552.235 µs) : 531, 573
.   : milestone, 552,
iast_GLOBAL (509.434 µs) : 487, 532
.   : milestone, 509,
iast_HARDCODED_SECRET_DISABLED (481.874 µs) : 460, 504
.   : milestone, 482,
iast_INACTIVE (455.26 µs) : 434, 477
.   : milestone, 455,
iast_TELEMETRY_OFF (466.812 µs) : 445, 488
.   : milestone, 467,
tracing (444.224 µs) : 424, 465
.   : milestone, 444,
section candidate
no_agent (367.373 µs) : 347, 387
.   : milestone, 367,
iast (484.909 µs) : 463, 507
.   : milestone, 485,
iast_FULL (550.803 µs) : 530, 572
.   : milestone, 551,
iast_GLOBAL (509.137 µs) : 487, 531
.   : milestone, 509,
iast_HARDCODED_SECRET_DISABLED (481.96 µs) : 461, 503
.   : milestone, 482,
iast_INACTIVE (456.057 µs) : 435, 477
.   : milestone, 456,
iast_TELEMETRY_OFF (466.959 µs) : 446, 488
.   : milestone, 467,
tracing (441.608 µs) : 421, 462
.   : milestone, 442,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 369.75 µs [347.973 µs, 391.527 µs] -
iast 476.569 µs [455.824 µs, 497.314 µs] 106.819 µs (28.9%)
iast_FULL 552.235 µs [531.284 µs, 573.186 µs] 182.485 µs (49.4%)
iast_GLOBAL 509.434 µs [486.525 µs, 532.342 µs] 139.683 µs (37.8%)
iast_HARDCODED_SECRET_DISABLED 481.874 µs [460.209 µs, 503.54 µs] 112.124 µs (30.3%)
iast_INACTIVE 455.26 µs [433.526 µs, 476.993 µs] 85.509 µs (23.1%)
iast_TELEMETRY_OFF 466.812 µs [445.387 µs, 488.237 µs] 97.062 µs (26.3%)
tracing 444.224 µs [423.502 µs, 464.946 µs] 74.474 µs (20.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 367.373 µs [347.385 µs, 387.362 µs] -
iast 484.909 µs [463.123 µs, 506.695 µs] 117.536 µs (32.0%)
iast_FULL 550.803 µs [529.629 µs, 571.977 µs] 183.43 µs (49.9%)
iast_GLOBAL 509.137 µs [487.305 µs, 530.97 µs] 141.764 µs (38.6%)
iast_HARDCODED_SECRET_DISABLED 481.96 µs [460.594 µs, 503.326 µs] 114.587 µs (31.2%)
iast_INACTIVE 456.057 µs [434.79 µs, 477.324 µs] 88.684 µs (24.1%)
iast_TELEMETRY_OFF 466.959 µs [446.16 µs, 487.758 µs] 99.586 µs (27.1%)
tracing 441.608 µs [420.907 µs, 462.31 µs] 74.235 µs (20.2%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~9f1b9fa617, baseline=1.38.0-SNAPSHOT~bf41350429
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.35 ms) : 1331, 1369
.   : milestone, 1350,
appsec (1.724 ms) : 1701, 1747
.   : milestone, 1724,
appsec_no_iast (1.736 ms) : 1712, 1760
.   : milestone, 1736,
iast (1.481 ms) : 1458, 1504
.   : milestone, 1481,
profiling (1.493 ms) : 1469, 1517
.   : milestone, 1493,
tracing (1.453 ms) : 1428, 1478
.   : milestone, 1453,
section candidate
no_agent (1.333 ms) : 1313, 1352
.   : milestone, 1333,
appsec (1.719 ms) : 1694, 1743
.   : milestone, 1719,
appsec_no_iast (1.733 ms) : 1709, 1756
.   : milestone, 1733,
iast (1.485 ms) : 1463, 1507
.   : milestone, 1485,
profiling (1.479 ms) : 1455, 1503
.   : milestone, 1479,
tracing (1.469 ms) : 1443, 1494
.   : milestone, 1469,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.35 ms [1.331 ms, 1.369 ms] -
appsec 1.724 ms [1.701 ms, 1.747 ms] 373.894 µs (27.7%)
appsec_no_iast 1.736 ms [1.712 ms, 1.76 ms] 385.609 µs (28.6%)
iast 1.481 ms [1.458 ms, 1.504 ms] 130.72 µs (9.7%)
profiling 1.493 ms [1.469 ms, 1.517 ms] 142.954 µs (10.6%)
tracing 1.453 ms [1.428 ms, 1.478 ms] 102.838 µs (7.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.333 ms [1.313 ms, 1.352 ms] -
appsec 1.719 ms [1.694 ms, 1.743 ms] 385.969 µs (29.0%)
appsec_no_iast 1.733 ms [1.709 ms, 1.756 ms] 400.136 µs (30.0%)
iast 1.485 ms [1.463 ms, 1.507 ms] 151.845 µs (11.4%)
profiling 1.479 ms [1.455 ms, 1.503 ms] 145.917 µs (10.9%)
tracing 1.469 ms [1.443 ms, 1.494 ms] 135.796 µs (10.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/one-pipeline
git_commit_date 1721393191 1721407163
git_commit_sha bf41350429 9f1b9fa617
release_version 1.38.0-SNAPSHOT~bf41350429 1.38.0-SNAPSHOT~9f1b9fa617
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1721409066 1721409066
ci_job_id 578810275 578810275
ci_pipeline_id 39674390 39674390
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~9f1b9fa617, baseline=1.38.0-SNAPSHOT~bf41350429
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.462 ms) : 1450, 1473
.   : milestone, 1462,
appsec (2.214 ms) : 2179, 2248
.   : milestone, 2214,
iast (1.972 ms) : 1930, 2014
.   : milestone, 1972,
iast_GLOBAL (2.001 ms) : 1959, 2043
.   : milestone, 2001,
profiling (1.86 ms) : 1826, 1894
.   : milestone, 1860,
tracing (1.836 ms) : 1803, 1870
.   : milestone, 1836,
section candidate
no_agent (1.462 ms) : 1450, 1473
.   : milestone, 1462,
appsec (2.217 ms) : 2182, 2252
.   : milestone, 2217,
iast (1.967 ms) : 1925, 2009
.   : milestone, 1967,
iast_GLOBAL (2.0 ms) : 1958, 2042
.   : milestone, 2000,
profiling (2.297 ms) : 2127, 2467
.   : milestone, 2297,
tracing (1.84 ms) : 1807, 1873
.   : milestone, 1840,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.45 ms, 1.473 ms] -
appsec 2.214 ms [2.179 ms, 2.248 ms] 751.646 µs (51.4%)
iast 1.972 ms [1.93 ms, 2.014 ms] 510.134 µs (34.9%)
iast_GLOBAL 2.001 ms [1.959 ms, 2.043 ms] 539.265 µs (36.9%)
profiling 1.86 ms [1.826 ms, 1.894 ms] 398.435 µs (27.3%)
tracing 1.836 ms [1.803 ms, 1.87 ms] 374.529 µs (25.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.45 ms, 1.473 ms] -
appsec 2.217 ms [2.182 ms, 2.252 ms] 755.262 µs (51.7%)
iast 1.967 ms [1.925 ms, 2.009 ms] 505.701 µs (34.6%)
iast_GLOBAL 2.0 ms [1.958 ms, 2.042 ms] 538.302 µs (36.8%)
profiling 2.297 ms [2.127 ms, 2.467 ms] 835.468 µs (57.2%)
tracing 1.84 ms [1.807 ms, 1.873 ms] 378.511 µs (25.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~9f1b9fa617, baseline=1.38.0-SNAPSHOT~bf41350429
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.942 s) : 14942000, 14942000
.   : milestone, 14942000,
appsec (15.291 s) : 15291000, 15291000
.   : milestone, 15291000,
iast (18.586 s) : 18586000, 18586000
.   : milestone, 18586000,
iast_GLOBAL (17.805 s) : 17805000, 17805000
.   : milestone, 17805000,
profiling (15.216 s) : 15216000, 15216000
.   : milestone, 15216000,
tracing (14.94 s) : 14940000, 14940000
.   : milestone, 14940000,
section candidate
no_agent (15.383 s) : 15383000, 15383000
.   : milestone, 15383000,
appsec (15.412 s) : 15412000, 15412000
.   : milestone, 15412000,
iast (18.761 s) : 18761000, 18761000
.   : milestone, 18761000,
iast_GLOBAL (17.768 s) : 17768000, 17768000
.   : milestone, 17768000,
profiling (15.301 s) : 15301000, 15301000
.   : milestone, 15301000,
tracing (14.91 s) : 14910000, 14910000
.   : milestone, 14910000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.942 s [14.942 s, 14.942 s] -
appsec 15.291 s [15.291 s, 15.291 s] 349.0 ms (2.3%)
iast 18.586 s [18.586 s, 18.586 s] 3.644 s (24.4%)
iast_GLOBAL 17.805 s [17.805 s, 17.805 s] 2.863 s (19.2%)
profiling 15.216 s [15.216 s, 15.216 s] 274.0 ms (1.8%)
tracing 14.94 s [14.94 s, 14.94 s] -2.0 ms (-0.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.383 s [15.383 s, 15.383 s] -
appsec 15.412 s [15.412 s, 15.412 s] 29.0 ms (0.2%)
iast 18.761 s [18.761 s, 18.761 s] 3.378 s (22.0%)
iast_GLOBAL 17.768 s [17.768 s, 17.768 s] 2.385 s (15.5%)
profiling 15.301 s [15.301 s, 15.301 s] -82.0 ms (-0.5%)
tracing 14.91 s [14.91 s, 14.91 s] -473.0 ms (-3.1%)

pr-commenter[bot] avatar Jun 28 '24 15:06 pr-commenter[bot]

@PerfectSlayer agreed. So much is removed from .gitlab-ci.yml that the diff is mostly useless.

For the pruning workflow, I'm going to take a second look once most libraries are onboarded to see if we can do something uniformly later. I updated the Readme to remove the two workflows removed with this PR

randomanderson avatar Jul 19 '24 14:07 randomanderson