[Support Snapshot]log bad payloads - based on 1.20.1

[nayeem-kamal]

trafficstars

What Does This Do

Motivation

Additional Notes

Jira ticket: [PROJ-IDENT]

[pr-commenter[bot]]

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nayeem-kamal/log-bad-payloads-backport
git_commit_date	1705942140	1705960023
git_commit_sha	9430bbc87c	fd2aa81c5c
release_version	1.29.0-SNAPSHOT~9430bbc87c	1.21.0-SNAPSHOT~fd2aa81c5c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1705962983	1705962983
ci_job_id	415291364	415291364
ci_pipeline_id	26953112	26953112
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	appsec	appsec

Summary

Found 42 performance improvements and 2 performance regressions! Performance is the same for 13 metrics, 5 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:appsec:Agent.start	better [-81.145ms; -73.206ms] or [-7.044%; -6.355%]	1.075s	1.152s
scenario:startup:insecure-bank:appsec:BytebuddyAgent	better [-54.853ms; -50.415ms] or [-8.237%; -7.570%]	613.323ms	665.957ms
scenario:startup:insecure-bank:appsec:GlobalTracer	better [-10.293ms; -7.310ms] or [-3.479%; -2.471%]	287.044ms	295.846ms
scenario:startup:insecure-bank:appsec:AppSec	better [-15.229ms; -13.776ms] or [-10.267%; -9.287%]	133.830ms	148.332ms
scenario:startup:insecure-bank:appsec:Remote Config	worse [+70.722µs; +93.622µs] or [+10.984%; +14.541%]	726.021µs	643.850µs
scenario:startup:insecure-bank:appsec:Telemetry	better [-1.197ms; -1.118ms] or [-17.348%; -16.206%]	5.743ms	6.900ms
scenario:startup:insecure-bank:iast:Agent.start	better [-83.080ms; -75.405ms] or [-7.070%; -6.417%]	1.096s	1.175s
scenario:startup:insecure-bank:iast:BytebuddyAgent	better [-55.044ms; -50.066ms] or [-7.104%; -6.461%]	722.315ms	774.870ms
scenario:startup:insecure-bank:iast:GlobalTracer	better [-15.179ms; -12.999ms] or [-5.313%; -4.550%]	271.621ms	285.710ms
scenario:startup:insecure-bank:iast:AppSec	better [-9.497ms; -5.027ms] or [-17.630%; -9.332%]	46.609ms	53.871ms
scenario:startup:insecure-bank:profiling:Agent.start	better [-133.782ms; -97.668ms] or [-10.421%; -7.608%]	1.168s	1.284s
scenario:startup:insecure-bank:profiling:ProfilingAgent	better [-49.026ms; -43.329ms] or [-39.368%; -34.794%]	78.354ms	124.531ms
scenario:startup:insecure-bank:profiling:BytebuddyAgent	better [-50.858ms; -30.564ms] or [-7.625%; -4.583%]	626.253ms	666.963ms
scenario:startup:insecure-bank:profiling:GlobalTracer	better [-27.472ms; -18.671ms] or [-7.266%; -4.939%]	354.993ms	378.065ms
scenario:startup:insecure-bank:profiling:AppSec	better [-2.923ms; -1.292ms] or [-5.709%; -2.523%]	49.095ms	51.203ms
scenario:startup:insecure-bank:profiling:Remote Config	better [-359.159µs; -317.689µs] or [-36.501%; -32.287%]	645.542µs	983.966µs
scenario:startup:insecure-bank:profiling:Telemetry	better [-1.544ms; -1.205ms] or [-21.110%; -16.481%]	5.939ms	7.314ms
scenario:startup:insecure-bank:profiling:Profiling	better [-49.027ms; -43.329ms] or [-39.361%; -34.787%]	78.379ms	124.557ms
scenario:startup:insecure-bank:tracing:Agent.start	better [-66.351ms; -59.637ms] or [-6.305%; -5.667%]	0.989s	1.052s
scenario:startup:insecure-bank:tracing:BytebuddyAgent	better [-53.898ms; -50.097ms] or [-8.109%; -7.537%]	612.645ms	664.643ms
scenario:startup:insecure-bank:tracing:GlobalTracer	better [-10.087ms; -6.873ms] or [-3.419%; -2.330%]	286.552ms	295.032ms
scenario:startup:insecure-bank:tracing:Telemetry	better [-1.300ms; -1.149ms] or [-18.102%; -15.997%]	5.959ms	7.184ms
scenario:startup:petclinic:appsec:Agent.start	better [-78.297ms; -71.024ms] or [-6.808%; -6.175%]	1.075s	1.150s
scenario:startup:petclinic:appsec:BytebuddyAgent	better [-52.887ms; -48.733ms] or [-7.955%; -7.330%]	614.057ms	664.867ms
scenario:startup:petclinic:appsec:GlobalTracer	better [-10.170ms; -7.247ms] or [-3.439%; -2.450%]	287.056ms	295.764ms
scenario:startup:petclinic:appsec:AppSec	better [-14.902ms; -13.287ms] or [-10.083%; -8.991%]	133.696ms	147.791ms
scenario:startup:petclinic:appsec:Remote Config	worse [+67.957µs; +90.657µs] or [+10.534%; +14.052%]	724.449µs	645.142µs
scenario:startup:petclinic:appsec:Telemetry	better [-1.214ms; -1.119ms] or [-17.619%; -16.241%]	5.725ms	6.892ms
scenario:startup:petclinic:iast:Agent.start	better [-82.513ms; -42.228ms] or [-7.045%; -3.606%]	1.109s	1.171s
scenario:startup:petclinic:iast:BytebuddyAgent	better [-54.880ms; -26.823ms] or [-7.114%; -3.477%]	730.622ms	771.473ms
scenario:startup:petclinic:iast:GlobalTracer	better [-14.178ms; -5.707ms] or [-4.979%; -2.004%]	274.805ms	284.748ms
scenario:startup:petclinic:iast:AppSec	better [-7.005ms; -2.007ms] or [-13.515%; -3.872%]	47.330ms	51.836ms
scenario:startup:petclinic:profiling:Agent.start	better [-129.578ms; -94.232ms] or [-10.098%; -7.343%]	1.171s	1.283s
scenario:startup:petclinic:profiling:ProfilingAgent	better [-47.951ms; -42.864ms] or [-38.562%; -34.471%]	78.940ms	124.348ms
scenario:startup:petclinic:profiling:BytebuddyAgent	better [-49.482ms; -30.184ms] or [-7.423%; -4.528%]	626.722ms	666.555ms
scenario:startup:petclinic:profiling:GlobalTracer	better [-25.419ms; -16.471ms] or [-6.727%; -4.359%]	356.936ms	377.881ms
scenario:startup:petclinic:profiling:AppSec	better [-2.996ms; -1.238ms] or [-5.830%; -2.410%]	49.270ms	51.388ms
scenario:startup:petclinic:profiling:Remote Config	better [-375.647µs; -308.981µs] or [-37.790%; -31.084%]	651.716µs	994.030µs
scenario:startup:petclinic:profiling:Telemetry	better [-1.527ms; -1.173ms] or [-20.784%; -15.959%]	5.997ms	7.347ms
scenario:startup:petclinic:profiling:Profiling	better [-47.953ms; -42.865ms] or [-38.556%; -34.465%]	78.964ms	124.372ms
scenario:startup:petclinic:tracing:Agent.start	better [-83.671ms; -56.351ms] or [-7.887%; -5.312%]	0.991s	1.061s
scenario:startup:petclinic:tracing:BytebuddyAgent	better [-65.557ms; -47.803ms] or [-9.784%; -7.135%]	613.326ms	670.006ms
scenario:startup:petclinic:tracing:GlobalTracer	better [-13.918ms; -6.524ms] or [-4.675%; -2.192%]	287.462ms	297.683ms
scenario:startup:petclinic:tracing:Telemetry	better [-1.395ms; -1.131ms] or [-19.305%; -15.644%]	5.964ms	7.227ms

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.21.0-SNAPSHOT~fd2aa81c5c, baseline=1.29.0-SNAPSHOT~9430bbc87c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1060920
Total [baseline] (9.398 s) : 0, 9398249
Agent [candidate] (990.909 ms) : 0, 990909
Total [candidate] (9.242 s) : 0, 9242403
section appsec
Agent [baseline] (1.15 s) : 0, 1150122
Total [baseline] (9.514 s) : 0, 9513633
Agent [candidate] (1.075 s) : 0, 1075462
Total [candidate] (9.352 s) : 0, 9352312
section iast
Agent [baseline] (1.171 s) : 0, 1171153
Total [baseline] (9.563 s) : 0, 9562722
Agent [candidate] (1.109 s) : 0, 1108782
Total [candidate] (9.531 s) : 0, 9530785
section profiling
Agent [baseline] (1.283 s) : 0, 1283199
Total [baseline] (9.643 s) : 0, 9642640
Agent [candidate] (1.171 s) : 0, 1171295
Total [candidate] (9.55 s) : 0, 9549541

• baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.061 s	-
Agent	appsec	1.15 s	89.202 ms (8.4%)
Agent	iast	1.171 s	110.233 ms (10.4%)
Agent	profiling	1.283 s	222.279 ms (21.0%)
Total	tracing	9.398 s	-
Total	appsec	9.514 s	115.384 ms (1.2%)
Total	iast	9.563 s	164.473 ms (1.8%)
Total	profiling	9.643 s	244.391 ms (2.6%)

• candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	990.909 ms	-
Agent	appsec	1.075 s	84.553 ms (8.5%)
Agent	iast	1.109 s	117.873 ms (11.9%)
Agent	profiling	1.171 s	180.386 ms (18.2%)
Total	tracing	9.242 s	-
Total	appsec	9.352 s	109.909 ms (1.2%)
Total	iast	9.531 s	288.382 ms (3.1%)
Total	profiling	9.55 s	307.137 ms (3.3%)

gantt
    title petclinic - break down per module: candidate=1.21.0-SNAPSHOT~fd2aa81c5c, baseline=1.29.0-SNAPSHOT~9430bbc87c

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.006 ms) : 0, 670006
BytebuddyAgent [candidate] (613.326 ms) : 0, 613326
GlobalTracer [baseline] (297.683 ms) : 0, 297683
GlobalTracer [candidate] (287.462 ms) : 0, 287462
AppSec [baseline] (50.819 ms) : 0, 50819
AppSec [candidate] (49.43 ms) : 0, 49430
Remote Config [baseline] (654.21 µs) : 0, 654
Remote Config [candidate] (673.873 µs) : 0, 674
Telemetry [baseline] (7.227 ms) : 0, 7227
Telemetry [candidate] (5.964 ms) : 0, 5964
section appsec
BytebuddyAgent [baseline] (664.867 ms) : 0, 664867
BytebuddyAgent [candidate] (614.057 ms) : 0, 614057
GlobalTracer [baseline] (295.764 ms) : 0, 295764
GlobalTracer [candidate] (287.056 ms) : 0, 287056
AppSec [baseline] (147.791 ms) : 0, 147791
AppSec [candidate] (133.696 ms) : 0, 133696
Remote Config [baseline] (645.142 µs) : 0, 645
Remote Config [candidate] (724.449 µs) : 0, 724
Telemetry [baseline] (6.892 ms) : 0, 6892
Telemetry [candidate] (5.725 ms) : 0, 5725
section iast
BytebuddyAgent [baseline] (771.473 ms) : 0, 771473
BytebuddyAgent [candidate] (730.622 ms) : 0, 730622
GlobalTracer [baseline] (284.748 ms) : 0, 284748
GlobalTracer [candidate] (274.805 ms) : 0, 274805
AppSec [baseline] (51.836 ms) : 0, 51836
AppSec [candidate] (47.33 ms) : 0, 47330
Remote Config [baseline] (599.411 µs) : 0, 599
Remote Config [candidate] (601.487 µs) : 0, 601
Telemetry [baseline] (8.889 ms) : 0, 8889
Telemetry [candidate] (5.952 ms) : 0, 5952
IAST [baseline] (19.56 ms) : 0, 19560
IAST [candidate] (14.74 ms) : 0, 14740
section profiling
ProfilingAgent [baseline] (124.348 ms) : 0, 124348
ProfilingAgent [candidate] (78.94 ms) : 0, 78940
BytebuddyAgent [baseline] (666.555 ms) : 0, 666555
BytebuddyAgent [candidate] (626.722 ms) : 0, 626722
GlobalTracer [baseline] (377.881 ms) : 0, 377881
GlobalTracer [candidate] (356.936 ms) : 0, 356936
AppSec [baseline] (51.388 ms) : 0, 51388
AppSec [candidate] (49.27 ms) : 0, 49270
Remote Config [baseline] (994.03 µs) : 0, 994
Remote Config [candidate] (651.716 µs) : 0, 652
Telemetry [baseline] (7.347 ms) : 0, 7347
Telemetry [candidate] (5.997 ms) : 0, 5997
Profiling [baseline] (124.372 ms) : 0, 124372
Profiling [candidate] (78.964 ms) : 0, 78964

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.21.0-SNAPSHOT~fd2aa81c5c, baseline=1.29.0-SNAPSHOT~9430bbc87c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052336
Total [baseline] (8.783 s) : 0, 8782650
Agent [candidate] (989.342 ms) : 0, 989342
Total [candidate] (8.626 s) : 0, 8626013
section appsec
Agent [baseline] (1.152 s) : 0, 1151952
Total [baseline] (8.85 s) : 0, 8850182
Agent [candidate] (1.075 s) : 0, 1074777
Total [candidate] (8.688 s) : 0, 8687788
section iast
Agent [baseline] (1.175 s) : 0, 1175079
Total [baseline] (9.285 s) : 0, 9285184
Agent [candidate] (1.096 s) : 0, 1095837
Total [candidate] (9.197 s) : 0, 9197456
section profiling
Agent [baseline] (1.284 s) : 0, 1283736
Total [baseline] (8.935 s) : 0, 8935049
Agent [candidate] (1.168 s) : 0, 1168011
Total [candidate] (8.843 s) : 0, 8842873

• baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.052 s	-
Agent	appsec	1.152 s	99.616 ms (9.5%)
Agent	iast	1.175 s	122.743 ms (11.7%)
Agent	profiling	1.284 s	231.4 ms (22.0%)
Total	tracing	8.783 s	-
Total	appsec	8.85 s	67.532 ms (0.8%)
Total	iast	9.285 s	502.534 ms (5.7%)
Total	profiling	8.935 s	152.399 ms (1.7%)

• candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	989.342 ms	-
Agent	appsec	1.075 s	85.434 ms (8.6%)
Agent	iast	1.096 s	106.494 ms (10.8%)
Agent	profiling	1.168 s	178.669 ms (18.1%)
Total	tracing	8.626 s	-
Total	appsec	8.688 s	61.775 ms (0.7%)
Total	iast	9.197 s	571.443 ms (6.6%)
Total	profiling	8.843 s	216.86 ms (2.5%)

gantt
    title insecure-bank - break down per module: candidate=1.21.0-SNAPSHOT~fd2aa81c5c, baseline=1.29.0-SNAPSHOT~9430bbc87c

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (664.643 ms) : 0, 664643
BytebuddyAgent [candidate] (612.645 ms) : 0, 612645
GlobalTracer [baseline] (295.032 ms) : 0, 295032
GlobalTracer [candidate] (286.552 ms) : 0, 286552
AppSec [baseline] (50.667 ms) : 0, 50667
AppSec [candidate] (49.368 ms) : 0, 49368
Remote Config [baseline] (660.215 µs) : 0, 660
Remote Config [candidate] (671.692 µs) : 0, 672
Telemetry [baseline] (7.184 ms) : 0, 7184
Telemetry [candidate] (5.959 ms) : 0, 5959
section appsec
BytebuddyAgent [baseline] (665.957 ms) : 0, 665957
BytebuddyAgent [candidate] (613.323 ms) : 0, 613323
GlobalTracer [baseline] (295.846 ms) : 0, 295846
GlobalTracer [candidate] (287.044 ms) : 0, 287044
AppSec [baseline] (148.332 ms) : 0, 148332
AppSec [candidate] (133.83 ms) : 0, 133830
Remote Config [baseline] (643.85 µs) : 0, 644
Remote Config [candidate] (726.021 µs) : 0, 726
Telemetry [baseline] (6.9 ms) : 0, 6900
Telemetry [candidate] (5.743 ms) : 0, 5743
section iast
BytebuddyAgent [baseline] (774.87 ms) : 0, 774870
BytebuddyAgent [candidate] (722.315 ms) : 0, 722315
GlobalTracer [baseline] (285.71 ms) : 0, 285710
GlobalTracer [candidate] (271.621 ms) : 0, 271621
AppSec [baseline] (53.871 ms) : 0, 53871
AppSec [candidate] (46.609 ms) : 0, 46609
Remote Config [baseline] (596.071 µs) : 0, 596
Remote Config [candidate] (600.507 µs) : 0, 601
Telemetry [baseline] (7.311 ms) : 0, 7311
Telemetry [candidate] (5.891 ms) : 0, 5891
IAST [baseline] (18.455 ms) : 0, 18455
IAST [candidate] (14.502 ms) : 0, 14502
section profiling
ProfilingAgent [baseline] (124.531 ms) : 0, 124531
ProfilingAgent [candidate] (78.354 ms) : 0, 78354
BytebuddyAgent [baseline] (666.963 ms) : 0, 666963
BytebuddyAgent [candidate] (626.253 ms) : 0, 626253
GlobalTracer [baseline] (378.065 ms) : 0, 378065
GlobalTracer [candidate] (354.993 ms) : 0, 354993
AppSec [baseline] (51.203 ms) : 0, 51203
AppSec [candidate] (49.095 ms) : 0, 49095
Remote Config [baseline] (983.966 µs) : 0, 984
Remote Config [candidate] (645.542 µs) : 0, 646
Telemetry [baseline] (7.314 ms) : 0, 7314
Telemetry [candidate] (5.939 ms) : 0, 5939
Profiling [baseline] (124.557 ms) : 0, 124557
Profiling [candidate] (78.379 ms) : 0, 78379

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2024-01-22T22:13:54	2024-01-22T22:32:10
git_branch	master	nayeem-kamal/log-bad-payloads-backport
git_commit_date	1705942140	1705960023
git_commit_sha	9430bbc87c	fd2aa81c5c
release_version	1.29.0-SNAPSHOT~9430bbc87c	1.21.0-SNAPSHOT~fd2aa81c5c
start_time	2024-01-22T22:13:35	2024-01-22T22:31:52

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1705962983	1705962983
ci_job_id	415291364	415291364
ci_pipeline_id	26953112	26953112
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 14 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:appsec	better [-77.404µs; -33.098µs] or [-10.579%; -4.524%]	unstable [-900.267op/s; +1531.846op/s] or [-15.004%; +25.531%]	676.409µs	6315.789op/s	731.660µs	6000.000op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.21.0-SNAPSHOT~fd2aa81c5c, baseline=1.29.0-SNAPSHOT~9430bbc87c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.349 ms) : 1330, 1368
.   : milestone, 1349,
appsec (1.797 ms) : 1771, 1822
.   : milestone, 1797,
iast (1.549 ms) : 1525, 1574
.   : milestone, 1549,
profiling (1.583 ms) : 1556, 1609
.   : milestone, 1583,
tracing (1.486 ms) : 1462, 1511
.   : milestone, 1486,
section candidate
no_agent (1.345 ms) : 1326, 1364
.   : milestone, 1345,
appsec (1.747 ms) : 1722, 1772
.   : milestone, 1747,
iast (1.549 ms) : 1524, 1574
.   : milestone, 1549,
profiling (1.544 ms) : 1517, 1571
.   : milestone, 1544,
tracing (1.519 ms) : 1494, 1544
.   : milestone, 1519,

• baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.349 ms [1.33 ms, 1.368 ms]	-
appsec	1.797 ms [1.771 ms, 1.822 ms]	447.688 µs (33.2%)
iast	1.549 ms [1.525 ms, 1.574 ms]	200.375 µs (14.9%)
profiling	1.583 ms [1.556 ms, 1.609 ms]	233.566 µs (17.3%)
tracing	1.486 ms [1.462 ms, 1.511 ms]	137.381 µs (10.2%)

• candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.345 ms [1.326 ms, 1.364 ms]	-
appsec	1.747 ms [1.722 ms, 1.772 ms]	401.902 µs (29.9%)
iast	1.549 ms [1.524 ms, 1.574 ms]	204.119 µs (15.2%)
profiling	1.544 ms [1.517 ms, 1.571 ms]	199.428 µs (14.8%)
tracing	1.519 ms [1.494 ms, 1.544 ms]	174.063 µs (12.9%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.21.0-SNAPSHOT~fd2aa81c5c, baseline=1.29.0-SNAPSHOT~9430bbc87c
    dateFormat X
    axisFormat %s
section baseline
no_agent (363.871 µs) : 344, 384
.   : milestone, 364,
appsec (731.66 µs) : 711, 753
.   : milestone, 732,
iast (484.365 µs) : 464, 505
.   : milestone, 484,
iast_FULL (546.879 µs) : 526, 567
.   : milestone, 547,
iast_INACTIVE (450.038 µs) : 429, 471
.   : milestone, 450,
profiling (452.393 µs) : 431, 473
.   : milestone, 452,
tracing (446.377 µs) : 426, 467
.   : milestone, 446,
section candidate
no_agent (363.472 µs) : 344, 383
.   : milestone, 363,
appsec (676.409 µs) : 656, 697
.   : milestone, 676,
iast (466.15 µs) : 446, 486
.   : milestone, 466,
iast_FULL (537.369 µs) : 517, 558
.   : milestone, 537,
iast_INACTIVE (444.482 µs) : 424, 465
.   : milestone, 444,
profiling (449.143 µs) : 428, 470
.   : milestone, 449,
tracing (446.084 µs) : 426, 466
.   : milestone, 446,

• baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	363.871 µs [344.139 µs, 383.602 µs]	-
appsec	731.66 µs [710.657 µs, 752.663 µs]	367.789 µs (101.1%)
iast	484.365 µs [463.615 µs, 505.115 µs]	120.494 µs (33.1%)
iast_FULL	546.879 µs [526.402 µs, 567.356 µs]	183.008 µs (50.3%)
iast_INACTIVE	450.038 µs [429.166 µs, 470.911 µs]	86.168 µs (23.7%)
profiling	452.393 µs [431.385 µs, 473.402 µs]	88.523 µs (24.3%)
tracing	446.377 µs [425.696 µs, 467.057 µs]	82.506 µs (22.7%)

• candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	363.472 µs [343.604 µs, 383.341 µs]	-
appsec	676.409 µs [656.248 µs, 696.57 µs]	312.937 µs (86.1%)
iast	466.15 µs [445.861 µs, 486.44 µs]	102.678 µs (28.2%)
iast_FULL	537.369 µs [517.047 µs, 557.69 µs]	173.896 µs (47.8%)
iast_INACTIVE	444.482 µs [424.211 µs, 464.753 µs]	81.01 µs (22.3%)
profiling	449.143 µs [427.982 µs, 470.304 µs]	85.671 µs (23.6%)
tracing	446.084 µs [426.252 µs, 465.916 µs]	82.612 µs (22.7%)