dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

Published 20 hours ago • verified publisher icon DataDog

Add remote config support for auto user id collection mode

Open manuel-alvarez-alvarez opened this issue 1 year ago • 1 comments

What Does This Do

Adds remote config support to the auto user id collection mode.

Motivation

Additional Notes

Jira ticket: APPSEC-53547

RFC: link

manuel-alvarez-alvarez avatar Jun 17 '24 08:06 manuel-alvarez-alvarez

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/waf-auto-user-id-rc-update
git_commit_date 1721814896 1721814995
git_commit_sha acff9cf9e9 b3d431f300
release_version 1.38.0-SNAPSHOT~acff9cf9e9 1.38.0-SNAPSHOT~b3d431f300
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1721817536 1721817536
ci_job_id 582773039 582773039
ci_pipeline_id 39979321 39979321
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 11 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.38.0-SNAPSHOT~b3d431f300, baseline=1.38.0-SNAPSHOT~acff9cf9e9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044838
Total [baseline] (8.496 s) : 0, 8495858
Agent [candidate] (1.046 s) : 0, 1045708
Total [candidate] (8.521 s) : 0, 8521028
section iast
Agent [baseline] (1.171 s) : 0, 1171295
Total [baseline] (8.963 s) : 0, 8963218
Agent [candidate] (1.176 s) : 0, 1175999
Total [candidate] (8.974 s) : 0, 8974491
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.174 s) : 0, 1173745
Total [baseline] (8.954 s) : 0, 8954020
Agent [candidate] (1.177 s) : 0, 1176750
Total [candidate] (8.959 s) : 0, 8958753
section iast_TELEMETRY_OFF
Agent [baseline] (1.168 s) : 0, 1167706
Total [baseline] (9.0 s) : 0, 8999853
Agent [candidate] (1.176 s) : 0, 1176256
Total [candidate] (8.973 s) : 0, 8972878
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent iast 1.171 s 126.457 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.174 s 128.907 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.168 s 122.868 ms (11.8%)
Total tracing 8.496 s -
Total iast 8.963 s 467.36 ms (5.5%)
Total iast_HARDCODED_SECRET_DISABLED 8.954 s 458.162 ms (5.4%)
Total iast_TELEMETRY_OFF 9.0 s 503.995 ms (5.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent iast 1.176 s 130.291 ms (12.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.177 s 131.043 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.176 s 130.548 ms (12.5%)
Total tracing 8.521 s -
Total iast 8.974 s 453.462 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.959 s 437.725 ms (5.1%)
Total iast_TELEMETRY_OFF 8.973 s 451.849 ms (5.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.38.0-SNAPSHOT~b3d431f300, baseline=1.38.0-SNAPSHOT~acff9cf9e9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (667.648 ms) : 0, 667648
BytebuddyAgent [candidate] (668.324 ms) : 0, 668324
GlobalTracer [baseline] (305.462 ms) : 0, 305462
GlobalTracer [candidate] (305.842 ms) : 0, 305842
AppSec [baseline] (49.99 ms) : 0, 49990
AppSec [candidate] (49.818 ms) : 0, 49818
Remote Config [baseline] (664.525 µs) : 0, 665
Remote Config [candidate] (755.257 µs) : 0, 755
Telemetry [baseline] (7.632 ms) : 0, 7632
Telemetry [candidate] (7.51 ms) : 0, 7510
section iast
BytebuddyAgent [baseline] (782.276 ms) : 0, 782276
BytebuddyAgent [candidate] (783.591 ms) : 0, 783591
GlobalTracer [baseline] (296.28 ms) : 0, 296280
GlobalTracer [candidate] (296.11 ms) : 0, 296110
AppSec [baseline] (47.395 ms) : 0, 47395
AppSec [candidate] (48.867 ms) : 0, 48867
IAST [baseline] (24.217 ms) : 0, 24217
IAST [candidate] (26.36 ms) : 0, 26360
Remote Config [baseline] (584.325 µs) : 0, 584
Remote Config [candidate] (569.508 µs) : 0, 570
Telemetry [baseline] (7.061 ms) : 0, 7061
Telemetry [candidate] (6.991 ms) : 0, 6991
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (781.702 ms) : 0, 781702
BytebuddyAgent [candidate] (783.122 ms) : 0, 783122
GlobalTracer [baseline] (295.796 ms) : 0, 295796
GlobalTracer [candidate] (296.062 ms) : 0, 296062
AppSec [baseline] (48.463 ms) : 0, 48463
AppSec [candidate] (48.959 ms) : 0, 48959
IAST [baseline] (26.654 ms) : 0, 26654
IAST [candidate] (27.464 ms) : 0, 27464
Remote Config [baseline] (597.331 µs) : 0, 597
Remote Config [candidate] (581.245 µs) : 0, 581
Telemetry [baseline] (7.024 ms) : 0, 7024
Telemetry [candidate] (7.005 ms) : 0, 7005
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (778.463 ms) : 0, 778463
BytebuddyAgent [candidate] (784.049 ms) : 0, 784049
GlobalTracer [baseline] (294.83 ms) : 0, 294830
GlobalTracer [candidate] (297.64 ms) : 0, 297640
AppSec [baseline] (47.563 ms) : 0, 47563
AppSec [candidate] (47.706 ms) : 0, 47706
IAST [baseline] (25.823 ms) : 0, 25823
IAST [candidate] (25.749 ms) : 0, 25749
Remote Config [baseline] (583.646 µs) : 0, 584
Remote Config [candidate] (595.893 µs) : 0, 596
Telemetry [baseline] (6.954 ms) : 0, 6954
Telemetry [candidate] (6.931 ms) : 0, 6931
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.38.0-SNAPSHOT~b3d431f300, baseline=1.38.0-SNAPSHOT~acff9cf9e9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1045045
Total [baseline] (10.389 s) : 0, 10389105
Agent [candidate] (1.059 s) : 0, 1059356
Total [candidate] (10.34 s) : 0, 10339904
section appsec
Agent [baseline] (1.164 s) : 0, 1164273
Total [baseline] (10.523 s) : 0, 10523152
Agent [candidate] (1.167 s) : 0, 1166730
Total [candidate] (10.47 s) : 0, 10470151
section iast
Agent [baseline] (1.179 s) : 0, 1179196
Total [baseline] (10.793 s) : 0, 10792953
Agent [candidate] (1.183 s) : 0, 1183462
Total [candidate] (10.765 s) : 0, 10765111
section profiling
Agent [baseline] (1.244 s) : 0, 1244435
Total [baseline] (10.598 s) : 0, 10598082
Agent [candidate] (1.25 s) : 0, 1250316
Total [candidate] (10.562 s) : 0, 10562360
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent appsec 1.164 s 119.227 ms (11.4%)
Agent iast 1.179 s 134.15 ms (12.8%)
Agent profiling 1.244 s 199.389 ms (19.1%)
Total tracing 10.389 s -
Total appsec 10.523 s 134.047 ms (1.3%)
Total iast 10.793 s 403.848 ms (3.9%)
Total profiling 10.598 s 208.977 ms (2.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.167 s 107.374 ms (10.1%)
Agent iast 1.183 s 124.106 ms (11.7%)
Agent profiling 1.25 s 190.96 ms (18.0%)
Total tracing 10.34 s -
Total appsec 10.47 s 130.246 ms (1.3%)
Total iast 10.765 s 425.207 ms (4.1%)
Total profiling 10.562 s 222.456 ms (2.2%) 
gantt
    title petclinic - break down per module: candidate=1.38.0-SNAPSHOT~b3d431f300, baseline=1.38.0-SNAPSHOT~acff9cf9e9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (667.071 ms) : 0, 667071
BytebuddyAgent [candidate] (677.346 ms) : 0, 677346
GlobalTracer [baseline] (306.383 ms) : 0, 306383
GlobalTracer [candidate] (309.404 ms) : 0, 309404
AppSec [baseline] (49.883 ms) : 0, 49883
AppSec [candidate] (50.443 ms) : 0, 50443
Remote Config [baseline] (659.797 µs) : 0, 660
Remote Config [candidate] (727.591 µs) : 0, 728
Telemetry [baseline] (7.582 ms) : 0, 7582
Telemetry [candidate] (7.726 ms) : 0, 7726
section appsec
BytebuddyAgent [baseline] (677.355 ms) : 0, 677355
BytebuddyAgent [candidate] (678.745 ms) : 0, 678745
GlobalTracer [baseline] (300.181 ms) : 0, 300181
GlobalTracer [candidate] (299.573 ms) : 0, 299573
AppSec [baseline] (154.27 ms) : 0, 154270
AppSec [candidate] (154.157 ms) : 0, 154157
Remote Config [baseline] (627.608 µs) : 0, 628
Remote Config [candidate] (628.31 µs) : 0, 628
Telemetry [baseline] (7.684 ms) : 0, 7684
Telemetry [candidate] (8.53 ms) : 0, 8530
IAST [baseline] (21.353 ms) : 0, 21353
IAST [candidate] (23.055 ms) : 0, 23055
section iast
BytebuddyAgent [baseline] (786.112 ms) : 0, 786112
BytebuddyAgent [candidate] (788.711 ms) : 0, 788711
GlobalTracer [baseline] (297.557 ms) : 0, 297557
GlobalTracer [candidate] (297.562 ms) : 0, 297562
AppSec [baseline] (48.809 ms) : 0, 48809
AppSec [candidate] (49.195 ms) : 0, 49195
Remote Config [baseline] (605.249 µs) : 0, 605
Remote Config [candidate] (575.812 µs) : 0, 576
Telemetry [baseline] (7.114 ms) : 0, 7114
Telemetry [candidate] (7.092 ms) : 0, 7092
IAST [baseline] (25.421 ms) : 0, 25421
IAST [candidate] (26.693 ms) : 0, 26693
section profiling
BytebuddyAgent [baseline] (664.699 ms) : 0, 664699
BytebuddyAgent [candidate] (667.995 ms) : 0, 667995
GlobalTracer [baseline] (389.174 ms) : 0, 389174
GlobalTracer [candidate] (390.021 ms) : 0, 390021
AppSec [baseline] (51.826 ms) : 0, 51826
AppSec [candidate] (51.747 ms) : 0, 51747
Remote Config [baseline] (651.658 µs) : 0, 652
Remote Config [candidate] (661.967 µs) : 0, 662
Telemetry [baseline] (7.375 ms) : 0, 7375
Telemetry [candidate] (7.437 ms) : 0, 7437
ProfilingAgent [baseline] (94.523 ms) : 0, 94523
ProfilingAgent [candidate] (95.287 ms) : 0, 95287
Profiling [baseline] (94.547 ms) : 0, 94547
Profiling [candidate] (95.311 ms) : 0, 95311

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-07-24T10:09:43 2024-07-24T10:16:29
git_branch master malvarez/waf-auto-user-id-rc-update
git_commit_date 1721814896 1721814995
git_commit_sha acff9cf9e9 b3d431f300
release_version 1.38.0-SNAPSHOT~acff9cf9e9 1.38.0-SNAPSHOT~b3d431f300
start_time 2024-07-24T10:09:31 2024-07-24T10:16:16
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1721816533 1721816533
ci_job_id 582773041 582773041
ci_pipeline_id 39979321 39979321
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 9 metrics, 18 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+36.675µs; +91.297µs] or [+2.482%; +6.178%]		 unstable
[-813.690op/s; +339.616op/s] or [-25.428%; +10.613%]		 1.542ms 2962.963op/s 1.478ms 3200.000op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~b3d431f300, baseline=1.38.0-SNAPSHOT~acff9cf9e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (363.149 µs) : 344, 382
.   : milestone, 363,
iast (470.642 µs) : 450, 491
.   : milestone, 471,
iast_FULL (544.759 µs) : 524, 566
.   : milestone, 545,
iast_GLOBAL (502.233 µs) : 481, 524
.   : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (473.96 µs) : 453, 495
.   : milestone, 474,
iast_INACTIVE (454.43 µs) : 432, 477
.   : milestone, 454,
iast_TELEMETRY_OFF (466.746 µs) : 445, 488
.   : milestone, 467,
tracing (428.241 µs) : 408, 448
.   : milestone, 428,
section candidate
no_agent (364.599 µs) : 345, 384
.   : milestone, 365,
iast (475.58 µs) : 454, 497
.   : milestone, 476,
iast_FULL (541.892 µs) : 521, 563
.   : milestone, 542,
iast_GLOBAL (496.335 µs) : 475, 518
.   : milestone, 496,
iast_HARDCODED_SECRET_DISABLED (476.452 µs) : 455, 498
.   : milestone, 476,
iast_INACTIVE (448.452 µs) : 426, 471
.   : milestone, 448,
iast_TELEMETRY_OFF (471.395 µs) : 449, 493
.   : milestone, 471,
tracing (426.86 µs) : 407, 447
.   : milestone, 427,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 363.149 µs [343.908 µs, 382.39 µs] -
iast 470.642 µs [449.826 µs, 491.458 µs] 107.493 µs (29.6%)
iast_FULL 544.759 µs [523.64 µs, 565.877 µs] 181.61 µs (50.0%)
iast_GLOBAL 502.233 µs [480.778 µs, 523.687 µs] 139.084 µs (38.3%)
iast_HARDCODED_SECRET_DISABLED 473.96 µs [452.814 µs, 495.105 µs] 110.811 µs (30.5%)
iast_INACTIVE 454.43 µs [432.298 µs, 476.561 µs] 91.281 µs (25.1%)
iast_TELEMETRY_OFF 466.746 µs [445.255 µs, 488.237 µs] 103.597 µs (28.5%)
tracing 428.241 µs [408.265 µs, 448.217 µs] 65.092 µs (17.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.599 µs [344.945 µs, 384.253 µs] -
iast 475.58 µs [453.995 µs, 497.165 µs] 110.981 µs (30.4%)
iast_FULL 541.892 µs [520.917 µs, 562.866 µs] 177.293 µs (48.6%)
iast_GLOBAL 496.335 µs [474.927 µs, 517.742 µs] 131.736 µs (36.1%)
iast_HARDCODED_SECRET_DISABLED 476.452 µs [455.17 µs, 497.735 µs] 111.853 µs (30.7%)
iast_INACTIVE 448.452 µs [426.03 µs, 470.873 µs] 83.853 µs (23.0%)
iast_TELEMETRY_OFF 471.395 µs [449.331 µs, 493.459 µs] 106.796 µs (29.3%)
tracing 426.86 µs [406.693 µs, 447.026 µs] 62.261 µs (17.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.38.0-SNAPSHOT~b3d431f300, baseline=1.38.0-SNAPSHOT~acff9cf9e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.328 ms) : 1308, 1349
.   : milestone, 1328,
appsec (1.692 ms) : 1668, 1716
.   : milestone, 1692,
appsec_no_iast (1.702 ms) : 1677, 1727
.   : milestone, 1702,
iast (1.47 ms) : 1447, 1492
.   : milestone, 1470,
profiling (1.478 ms) : 1453, 1502
.   : milestone, 1478,
tracing (1.468 ms) : 1444, 1491
.   : milestone, 1468,
section candidate
no_agent (1.336 ms) : 1317, 1354
.   : milestone, 1336,
appsec (1.717 ms) : 1693, 1740
.   : milestone, 1717,
appsec_no_iast (1.695 ms) : 1670, 1720
.   : milestone, 1695,
iast (1.477 ms) : 1455, 1500
.   : milestone, 1477,
profiling (1.542 ms) : 1515, 1568
.   : milestone, 1542,
tracing (1.46 ms) : 1435, 1485
.   : milestone, 1460,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.328 ms [1.308 ms, 1.349 ms] -
appsec 1.692 ms [1.668 ms, 1.716 ms] 363.692 µs (27.4%)
appsec_no_iast 1.702 ms [1.677 ms, 1.727 ms] 373.49 µs (28.1%)
iast 1.47 ms [1.447 ms, 1.492 ms] 141.222 µs (10.6%)
profiling 1.478 ms [1.453 ms, 1.502 ms] 149.325 µs (11.2%)
tracing 1.468 ms [1.444 ms, 1.491 ms] 139.219 µs (10.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.336 ms [1.317 ms, 1.354 ms] -
appsec 1.717 ms [1.693 ms, 1.74 ms] 381.0 µs (28.5%)
appsec_no_iast 1.695 ms [1.67 ms, 1.72 ms] 359.623 µs (26.9%)
iast 1.477 ms [1.455 ms, 1.5 ms] 141.896 µs (10.6%)
profiling 1.542 ms [1.515 ms, 1.568 ms] 206.074 µs (15.4%)
tracing 1.46 ms [1.435 ms, 1.485 ms] 124.704 µs (9.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/waf-auto-user-id-rc-update
git_commit_date 1721814896 1721814995
git_commit_sha acff9cf9e9 b3d431f300
release_version 1.38.0-SNAPSHOT~acff9cf9e9 1.38.0-SNAPSHOT~b3d431f300
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1721817038 1721817038
ci_job_id 582773042 582773042
ci_pipeline_id 39979321 39979321
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~b3d431f300, baseline=1.38.0-SNAPSHOT~acff9cf9e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.287 s) : 15287000, 15287000
.   : milestone, 15287000,
appsec (14.868 s) : 14868000, 14868000
.   : milestone, 14868000,
iast (18.652 s) : 18652000, 18652000
.   : milestone, 18652000,
iast_GLOBAL (17.747 s) : 17747000, 17747000
.   : milestone, 17747000,
profiling (15.423 s) : 15423000, 15423000
.   : milestone, 15423000,
tracing (15.265 s) : 15265000, 15265000
.   : milestone, 15265000,
section candidate
no_agent (15.455 s) : 15455000, 15455000
.   : milestone, 15455000,
appsec (15.049 s) : 15049000, 15049000
.   : milestone, 15049000,
iast (19.117 s) : 19117000, 19117000
.   : milestone, 19117000,
iast_GLOBAL (17.779 s) : 17779000, 17779000
.   : milestone, 17779000,
profiling (15.195 s) : 15195000, 15195000
.   : milestone, 15195000,
tracing (15.029 s) : 15029000, 15029000
.   : milestone, 15029000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.287 s [15.287 s, 15.287 s] -
appsec 14.868 s [14.868 s, 14.868 s] -419.0 ms (-2.7%)
iast 18.652 s [18.652 s, 18.652 s] 3.365 s (22.0%)
iast_GLOBAL 17.747 s [17.747 s, 17.747 s] 2.46 s (16.1%)
profiling 15.423 s [15.423 s, 15.423 s] 136.0 ms (0.9%)
tracing 15.265 s [15.265 s, 15.265 s] -22.0 ms (-0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.455 s [15.455 s, 15.455 s] -
appsec 15.049 s [15.049 s, 15.049 s] -406.0 ms (-2.6%)
iast 19.117 s [19.117 s, 19.117 s] 3.662 s (23.7%)
iast_GLOBAL 17.779 s [17.779 s, 17.779 s] 2.324 s (15.0%)
profiling 15.195 s [15.195 s, 15.195 s] -260.0 ms (-1.7%)
tracing 15.029 s [15.029 s, 15.029 s] -426.0 ms (-2.8%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.38.0-SNAPSHOT~b3d431f300, baseline=1.38.0-SNAPSHOT~acff9cf9e9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.461 ms) : 1449, 1473
.   : milestone, 1461,
appsec (2.224 ms) : 2188, 2259
.   : milestone, 2224,
iast (1.965 ms) : 1923, 2007
.   : milestone, 1965,
iast_GLOBAL (2.012 ms) : 1969, 2055
.   : milestone, 2012,
profiling (1.848 ms) : 1815, 1882
.   : milestone, 1848,
tracing (1.832 ms) : 1800, 1865
.   : milestone, 1832,
section candidate
no_agent (1.457 ms) : 1445, 1468
.   : milestone, 1457,
appsec (2.213 ms) : 2178, 2248
.   : milestone, 2213,
iast (1.958 ms) : 1916, 1999
.   : milestone, 1958,
iast_GLOBAL (2.017 ms) : 1975, 2059
.   : milestone, 2017,
profiling (1.861 ms) : 1827, 1895
.   : milestone, 1861,
tracing (1.824 ms) : 1792, 1856
.   : milestone, 1824,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.461 ms [1.449 ms, 1.473 ms] -
appsec 2.224 ms [2.188 ms, 2.259 ms] 762.562 µs (52.2%)
iast 1.965 ms [1.923 ms, 2.007 ms] 503.595 µs (34.5%)
iast_GLOBAL 2.012 ms [1.969 ms, 2.055 ms] 550.654 µs (37.7%)
profiling 1.848 ms [1.815 ms, 1.882 ms] 387.245 µs (26.5%)
tracing 1.832 ms [1.8 ms, 1.865 ms] 371.193 µs (25.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.457 ms [1.445 ms, 1.468 ms] -
appsec 2.213 ms [2.178 ms, 2.248 ms] 756.595 µs (51.9%)
iast 1.958 ms [1.916 ms, 1.999 ms] 501.254 µs (34.4%)
iast_GLOBAL 2.017 ms [1.975 ms, 2.059 ms] 560.42 µs (38.5%)
profiling 1.861 ms [1.827 ms, 1.895 ms] 404.767 µs (27.8%)
tracing 1.824 ms [1.792 ms, 1.856 ms] 367.676 µs (25.2%)

pr-commenter[bot] avatar Jun 17 '24 09:06 pr-commenter[bot]