dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

Published 20 hours ago • verified publisher icon DataDog

[WIP] Revert "remove unroll (#6748)"

Open mcculls opened this issue 1 year ago • 1 comments

This reverts commit bd8db8b42f84c808f98caac4675b20f75598696a.

mcculls avatar Jun 12 '24 17:06 mcculls

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/revert-remove-unroll
git_commit_date 1718873384 1718886624
git_commit_sha 01fd984c16 2a8ce7ca67
release_version 1.36.0-SNAPSHOT~01fd984c16 1.36.0-SNAPSHOT~2a8ce7ca67
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718889817 1718889817
ci_job_id 548867787 548867787
ci_pipeline_id 37165178 37165178
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~2a8ce7ca67, baseline=1.36.0-SNAPSHOT~01fd984c16

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068818
Total [baseline] (8.556 s) : 0, 8556106
Agent [candidate] (1.067 s) : 0, 1066732
Total [candidate] (8.575 s) : 0, 8574948
section iast
Agent [baseline] (1.18 s) : 0, 1179973
Total [baseline] (9.058 s) : 0, 9058445
Agent [candidate] (1.17 s) : 0, 1169801
Total [candidate] (9.007 s) : 0, 9007479
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.183 s) : 0, 1183223
Total [baseline] (9.01 s) : 0, 9009839
Agent [candidate] (1.191 s) : 0, 1190523
Total [candidate] (9.098 s) : 0, 9097799
section iast_TELEMETRY_OFF
Agent [baseline] (1.173 s) : 0, 1172815
Total [baseline] (8.995 s) : 0, 8995231
Agent [candidate] (1.16 s) : 0, 1159864
Total [candidate] (8.998 s) : 0, 8998302
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent iast 1.18 s 111.155 ms (10.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.183 s 114.405 ms (10.7%)
Agent iast_TELEMETRY_OFF 1.173 s 103.997 ms (9.7%)
Total tracing 8.556 s -
Total iast 9.058 s 502.34 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.01 s 453.733 ms (5.3%)
Total iast_TELEMETRY_OFF 8.995 s 439.126 ms (5.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent iast 1.17 s 103.069 ms (9.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.191 s 123.792 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.16 s 93.132 ms (8.7%)
Total tracing 8.575 s -
Total iast 9.007 s 432.531 ms (5.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.098 s 522.851 ms (6.1%)
Total iast_TELEMETRY_OFF 8.998 s 423.354 ms (4.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~2a8ce7ca67, baseline=1.36.0-SNAPSHOT~01fd984c16

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.462 ms) : 0, 670462
BytebuddyAgent [candidate] (668.801 ms) : 0, 668801
GlobalTracer [baseline] (304.976 ms) : 0, 304976
GlobalTracer [candidate] (304.446 ms) : 0, 304446
AppSec [baseline] (50.562 ms) : 0, 50562
AppSec [candidate] (50.624 ms) : 0, 50624
Remote Config [baseline] (690.793 µs) : 0, 691
Remote Config [candidate] (693.913 µs) : 0, 694
Telemetry [baseline] (7.578 ms) : 0, 7578
Telemetry [candidate] (7.618 ms) : 0, 7618
section iast
BytebuddyAgent [baseline] (789.401 ms) : 0, 789401
BytebuddyAgent [candidate] (779.968 ms) : 0, 779968
GlobalTracer [baseline] (294.789 ms) : 0, 294789
GlobalTracer [candidate] (293.635 ms) : 0, 293635
AppSec [baseline] (47.24 ms) : 0, 47240
AppSec [candidate] (47.108 ms) : 0, 47108
Remote Config [baseline] (650.608 µs) : 0, 651
Remote Config [candidate] (595.331 µs) : 0, 595
Telemetry [baseline] (7.037 ms) : 0, 7037
Telemetry [candidate] (7.615 ms) : 0, 7615
IAST [baseline] (27.415 ms) : 0, 27415
IAST [candidate] (27.57 ms) : 0, 27570
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (789.129 ms) : 0, 789129
BytebuddyAgent [candidate] (793.506 ms) : 0, 793506
GlobalTracer [baseline] (296.246 ms) : 0, 296246
GlobalTracer [candidate] (299.877 ms) : 0, 299877
AppSec [baseline] (47.993 ms) : 0, 47993
AppSec [candidate] (48.228 ms) : 0, 48228
Remote Config [baseline] (624.533 µs) : 0, 625
Remote Config [candidate] (623.912 µs) : 0, 624
Telemetry [baseline] (6.947 ms) : 0, 6947
Telemetry [candidate] (7.08 ms) : 0, 7080
IAST [baseline] (28.798 ms) : 0, 28798
IAST [candidate] (27.645 ms) : 0, 27645
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (781.268 ms) : 0, 781268
BytebuddyAgent [candidate] (774.097 ms) : 0, 774097
GlobalTracer [baseline] (294.972 ms) : 0, 294972
GlobalTracer [candidate] (292.522 ms) : 0, 292522
AppSec [baseline] (47.383 ms) : 0, 47383
AppSec [candidate] (47.053 ms) : 0, 47053
Remote Config [baseline] (596.933 µs) : 0, 597
Remote Config [candidate] (588.581 µs) : 0, 589
Telemetry [baseline] (9.127 ms) : 0, 9127
Telemetry [candidate] (8.495 ms) : 0, 8495
IAST [baseline] (26.082 ms) : 0, 26082
IAST [candidate] (23.777 ms) : 0, 23777
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~2a8ce7ca67, baseline=1.36.0-SNAPSHOT~01fd984c16

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1062769
Total [baseline] (10.372 s) : 0, 10372047
Agent [candidate] (1.069 s) : 0, 1069414
Total [candidate] (10.407 s) : 0, 10406694
section appsec
Agent [baseline] (1.185 s) : 0, 1184947
Total [baseline] (10.534 s) : 0, 10534404
Agent [candidate] (1.191 s) : 0, 1191199
Total [candidate] (10.513 s) : 0, 10512504
section iast
Agent [baseline] (1.177 s) : 0, 1177046
Total [baseline] (10.73 s) : 0, 10729975
Agent [candidate] (1.176 s) : 0, 1175823
Total [candidate] (10.758 s) : 0, 10758040
section profiling
Agent [baseline] (1.278 s) : 0, 1278116
Total [baseline] (10.64 s) : 0, 10640218
Agent [candidate] (1.265 s) : 0, 1264958
Total [candidate] (10.667 s) : 0, 10666503
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.185 s 122.178 ms (11.5%)
Agent iast 1.177 s 114.276 ms (10.8%)
Agent profiling 1.278 s 215.346 ms (20.3%)
Total tracing 10.372 s -
Total appsec 10.534 s 162.357 ms (1.6%)
Total iast 10.73 s 357.928 ms (3.5%)
Total profiling 10.64 s 268.171 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent appsec 1.191 s 121.784 ms (11.4%)
Agent iast 1.176 s 106.408 ms (10.0%)
Agent profiling 1.265 s 195.543 ms (18.3%)
Total tracing 10.407 s -
Total appsec 10.513 s 105.809 ms (1.0%)
Total iast 10.758 s 351.346 ms (3.4%)
Total profiling 10.667 s 259.809 ms (2.5%) 
gantt
    title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~2a8ce7ca67, baseline=1.36.0-SNAPSHOT~01fd984c16

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (666.065 ms) : 0, 666065
BytebuddyAgent [candidate] (670.052 ms) : 0, 670052
GlobalTracer [baseline] (304.136 ms) : 0, 304136
GlobalTracer [candidate] (305.701 ms) : 0, 305701
AppSec [baseline] (49.948 ms) : 0, 49948
AppSec [candidate] (50.699 ms) : 0, 50699
Remote Config [baseline] (685.452 µs) : 0, 685
Remote Config [candidate] (700.183 µs) : 0, 700
Telemetry [baseline] (7.523 ms) : 0, 7523
Telemetry [candidate] (7.624 ms) : 0, 7624
section appsec
BytebuddyAgent [baseline] (677.713 ms) : 0, 677713
BytebuddyAgent [candidate] (681.891 ms) : 0, 681891
GlobalTracer [baseline] (297.937 ms) : 0, 297937
GlobalTracer [candidate] (299.544 ms) : 0, 299544
AppSec [baseline] (154.007 ms) : 0, 154007
AppSec [candidate] (154.558 ms) : 0, 154558
Remote Config [baseline] (646.592 µs) : 0, 647
Remote Config [candidate] (647.253 µs) : 0, 647
Telemetry [baseline] (8.501 ms) : 0, 8501
Telemetry [candidate] (8.785 ms) : 0, 8785
IAST [baseline] (23.052 ms) : 0, 23052
IAST [candidate] (21.977 ms) : 0, 21977
section iast
BytebuddyAgent [baseline] (784.894 ms) : 0, 784894
BytebuddyAgent [candidate] (784.116 ms) : 0, 784116
GlobalTracer [baseline] (295.237 ms) : 0, 295237
GlobalTracer [candidate] (294.898 ms) : 0, 294898
AppSec [baseline] (47.216 ms) : 0, 47216
AppSec [candidate] (47.407 ms) : 0, 47407
Remote Config [baseline] (615.743 µs) : 0, 616
Remote Config [candidate] (616.932 µs) : 0, 617
Telemetry [baseline] (7.67 ms) : 0, 7670
Telemetry [candidate] (7.818 ms) : 0, 7818
IAST [baseline] (28.048 ms) : 0, 28048
IAST [candidate] (27.58 ms) : 0, 27580
section profiling
BytebuddyAgent [baseline] (671.951 ms) : 0, 671951
BytebuddyAgent [candidate] (665.765 ms) : 0, 665765
GlobalTracer [baseline] (389.579 ms) : 0, 389579
GlobalTracer [candidate] (385.391 ms) : 0, 385391
AppSec [baseline] (52.236 ms) : 0, 52236
AppSec [candidate] (51.418 ms) : 0, 51418
Remote Config [baseline] (755.745 µs) : 0, 756
Remote Config [candidate] (732.995 µs) : 0, 733
Telemetry [baseline] (7.468 ms) : 0, 7468
Telemetry [candidate] (7.411 ms) : 0, 7411
ProfilingAgent [baseline] (98.259 ms) : 0, 98259
ProfilingAgent [candidate] (96.853 ms) : 0, 96853
Profiling [baseline] (98.285 ms) : 0, 98285
Profiling [candidate] (96.878 ms) : 0, 96878

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-20T12:52:39 2024-06-20T12:59:27
git_branch master mcculls/revert-remove-unroll
git_commit_date 1718873384 1718886624
git_commit_sha 01fd984c16 2a8ce7ca67
release_version 1.36.0-SNAPSHOT~01fd984c16 1.36.0-SNAPSHOT~2a8ce7ca67
start_time 2024-06-20T12:52:26 2024-06-20T12:59:14
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718888710 1718888710
ci_job_id 548867788 548867788
ci_pipeline_id 37165178 37165178
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~2a8ce7ca67, baseline=1.36.0-SNAPSHOT~01fd984c16
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.325 ms) : 1305, 1344
.   : milestone, 1325,
appsec (1.731 ms) : 1707, 1754
.   : milestone, 1731,
appsec_no_iast (1.707 ms) : 1682, 1731
.   : milestone, 1707,
iast (1.469 ms) : 1447, 1492
.   : milestone, 1469,
profiling (1.472 ms) : 1447, 1496
.   : milestone, 1472,
tracing (1.465 ms) : 1442, 1489
.   : milestone, 1465,
section candidate
no_agent (1.342 ms) : 1323, 1361
.   : milestone, 1342,
appsec (1.711 ms) : 1686, 1735
.   : milestone, 1711,
appsec_no_iast (1.725 ms) : 1701, 1749
.   : milestone, 1725,
iast (1.473 ms) : 1450, 1496
.   : milestone, 1473,
profiling (1.472 ms) : 1448, 1497
.   : milestone, 1472,
tracing (1.458 ms) : 1434, 1481
.   : milestone, 1458,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.325 ms [1.305 ms, 1.344 ms] -
appsec 1.731 ms [1.707 ms, 1.754 ms] 406.008 µs (30.6%)
appsec_no_iast 1.707 ms [1.682 ms, 1.731 ms] 381.762 µs (28.8%)
iast 1.469 ms [1.447 ms, 1.492 ms] 144.697 µs (10.9%)
profiling 1.472 ms [1.447 ms, 1.496 ms] 147.076 µs (11.1%)
tracing 1.465 ms [1.442 ms, 1.489 ms] 140.606 µs (10.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.342 ms [1.323 ms, 1.361 ms] -
appsec 1.711 ms [1.686 ms, 1.735 ms] 368.726 µs (27.5%)
appsec_no_iast 1.725 ms [1.701 ms, 1.749 ms] 383.651 µs (28.6%)
iast 1.473 ms [1.45 ms, 1.496 ms] 131.05 µs (9.8%)
profiling 1.472 ms [1.448 ms, 1.497 ms] 130.562 µs (9.7%)
tracing 1.458 ms [1.434 ms, 1.481 ms] 115.789 µs (8.6%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~2a8ce7ca67, baseline=1.36.0-SNAPSHOT~01fd984c16
    dateFormat X
    axisFormat %s
section baseline
no_agent (372.644 µs) : 353, 392
.   : milestone, 373,
iast (474.958 µs) : 454, 496
.   : milestone, 475,
iast_FULL (547.359 µs) : 526, 569
.   : milestone, 547,
iast_GLOBAL (510.653 µs) : 488, 533
.   : milestone, 511,
iast_HARDCODED_SECRET_DISABLED (475.307 µs) : 454, 496
.   : milestone, 475,
iast_INACTIVE (453.135 µs) : 431, 475
.   : milestone, 453,
iast_TELEMETRY_OFF (466.416 µs) : 445, 488
.   : milestone, 466,
tracing (442.452 µs) : 421, 464
.   : milestone, 442,
section candidate
no_agent (364.784 µs) : 344, 385
.   : milestone, 365,
iast (472.938 µs) : 452, 494
.   : milestone, 473,
iast_FULL (541.443 µs) : 520, 562
.   : milestone, 541,
iast_GLOBAL (498.975 µs) : 477, 520
.   : milestone, 499,
iast_HARDCODED_SECRET_DISABLED (477.004 µs) : 455, 499
.   : milestone, 477,
iast_INACTIVE (457.013 µs) : 435, 479
.   : milestone, 457,
iast_TELEMETRY_OFF (463.647 µs) : 443, 484
.   : milestone, 464,
tracing (438.37 µs) : 417, 459
.   : milestone, 438,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.644 µs [352.934 µs, 392.353 µs] -
iast 474.958 µs [453.919 µs, 495.996 µs] 102.314 µs (27.5%)
iast_FULL 547.359 µs [526.204 µs, 568.514 µs] 174.715 µs (46.9%)
iast_GLOBAL 510.653 µs [488.214 µs, 533.091 µs] 138.009 µs (37.0%)
iast_HARDCODED_SECRET_DISABLED 475.307 µs [454.41 µs, 496.204 µs] 102.663 µs (27.5%)
iast_INACTIVE 453.135 µs [431.136 µs, 475.133 µs] 80.491 µs (21.6%)
iast_TELEMETRY_OFF 466.416 µs [445.291 µs, 487.54 µs] 93.772 µs (25.2%)
tracing 442.452 µs [421.134 µs, 463.77 µs] 69.808 µs (18.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.784 µs [344.168 µs, 385.4 µs] -
iast 472.938 µs [452.02 µs, 493.856 µs] 108.154 µs (29.6%)
iast_FULL 541.443 µs [520.407 µs, 562.478 µs] 176.659 µs (48.4%)
iast_GLOBAL 498.975 µs [477.454 µs, 520.496 µs] 134.191 µs (36.8%)
iast_HARDCODED_SECRET_DISABLED 477.004 µs [455.454 µs, 498.554 µs] 112.22 µs (30.8%)
iast_INACTIVE 457.013 µs [434.789 µs, 479.237 µs] 92.229 µs (25.3%)
iast_TELEMETRY_OFF 463.647 µs [442.869 µs, 484.424 µs] 98.862 µs (27.1%)
tracing 438.37 µs [417.311 µs, 459.429 µs] 73.586 µs (20.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/revert-remove-unroll
git_commit_date 1718873384 1718886624
git_commit_sha 01fd984c16 2a8ce7ca67
release_version 1.36.0-SNAPSHOT~01fd984c16 1.36.0-SNAPSHOT~2a8ce7ca67
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1718889311 1718889311
ci_job_id 548867789 548867789
ci_pipeline_id 37165178 37165178
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~2a8ce7ca67, baseline=1.36.0-SNAPSHOT~01fd984c16
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.658 s) : 15658000, 15658000
.   : milestone, 15658000,
appsec (15.105 s) : 15105000, 15105000
.   : milestone, 15105000,
iast (18.719 s) : 18719000, 18719000
.   : milestone, 18719000,
iast_GLOBAL (17.732 s) : 17732000, 17732000
.   : milestone, 17732000,
profiling (14.805 s) : 14805000, 14805000
.   : milestone, 14805000,
tracing (15.108 s) : 15108000, 15108000
.   : milestone, 15108000,
section candidate
no_agent (15.208 s) : 15208000, 15208000
.   : milestone, 15208000,
appsec (15.02 s) : 15020000, 15020000
.   : milestone, 15020000,
iast (18.707 s) : 18707000, 18707000
.   : milestone, 18707000,
iast_GLOBAL (17.954 s) : 17954000, 17954000
.   : milestone, 17954000,
profiling (15.309 s) : 15309000, 15309000
.   : milestone, 15309000,
tracing (15.162 s) : 15162000, 15162000
.   : milestone, 15162000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.658 s [15.658 s, 15.658 s] -
appsec 15.105 s [15.105 s, 15.105 s] -553.0 ms (-3.5%)
iast 18.719 s [18.719 s, 18.719 s] 3.061 s (19.5%)
iast_GLOBAL 17.732 s [17.732 s, 17.732 s] 2.074 s (13.2%)
profiling 14.805 s [14.805 s, 14.805 s] -853.0 ms (-5.4%)
tracing 15.108 s [15.108 s, 15.108 s] -550.0 ms (-3.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.208 s [15.208 s, 15.208 s] -
appsec 15.02 s [15.02 s, 15.02 s] -188.0 ms (-1.2%)
iast 18.707 s [18.707 s, 18.707 s] 3.499 s (23.0%)
iast_GLOBAL 17.954 s [17.954 s, 17.954 s] 2.746 s (18.1%)
profiling 15.309 s [15.309 s, 15.309 s] 101.0 ms (0.7%)
tracing 15.162 s [15.162 s, 15.162 s] -46.0 ms (-0.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~2a8ce7ca67, baseline=1.36.0-SNAPSHOT~01fd984c16
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.46 ms) : 1448, 1471
.   : milestone, 1460,
appsec (2.198 ms) : 2165, 2232
.   : milestone, 2198,
iast (1.96 ms) : 1919, 2002
.   : milestone, 1960,
iast_GLOBAL (1.996 ms) : 1956, 2037
.   : milestone, 1996,
profiling (1.852 ms) : 1819, 1886
.   : milestone, 1852,
tracing (1.827 ms) : 1795, 1859
.   : milestone, 1827,
section candidate
no_agent (1.455 ms) : 1444, 1466
.   : milestone, 1455,
appsec (2.204 ms) : 2170, 2238
.   : milestone, 2204,
iast (1.96 ms) : 1919, 2001
.   : milestone, 1960,
iast_GLOBAL (2.003 ms) : 1961, 2044
.   : milestone, 2003,
profiling (2.28 ms) : 2105, 2454
.   : milestone, 2280,
tracing (1.83 ms) : 1798, 1862
.   : milestone, 1830,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.46 ms [1.448 ms, 1.471 ms] -
appsec 2.198 ms [2.165 ms, 2.232 ms] 738.619 µs (50.6%)
iast 1.96 ms [1.919 ms, 2.002 ms] 500.726 µs (34.3%)
iast_GLOBAL 1.996 ms [1.956 ms, 2.037 ms] 536.706 µs (36.8%)
profiling 1.852 ms [1.819 ms, 1.886 ms] 392.861 µs (26.9%)
tracing 1.827 ms [1.795 ms, 1.859 ms] 367.641 µs (25.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.455 ms [1.444 ms, 1.466 ms] -
appsec 2.204 ms [2.17 ms, 2.238 ms] 748.705 µs (51.5%)
iast 1.96 ms [1.919 ms, 2.001 ms] 505.177 µs (34.7%)
iast_GLOBAL 2.003 ms [1.961 ms, 2.044 ms] 547.693 µs (37.6%)
profiling 2.28 ms [2.105 ms, 2.454 ms] 824.436 µs (56.7%)
tracing 1.83 ms [1.798 ms, 1.862 ms] 375.368 µs (25.8%)

pr-commenter[bot] avatar Jun 12 '24 18:06 pr-commenter[bot]