dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

Published 20 hours ago • verified publisher icon DataDog

Test branch

Open nenadnoveljic opened this issue 1 year ago • 1 comments

What Does This Do

Motivation

Additional Notes

Jira ticket: [PROJ-IDENT]

nenadnoveljic avatar Jun 17 '24 06:06 nenadnoveljic

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nenadnoveljic/test-branch
git_commit_date 1718392893 1718359413
git_commit_sha ecd93fb8b3 255b6a28cd
release_version 1.36.0-SNAPSHOT~ecd93fb8b3 1.36.0-SNAPSHOT~255b6a28cd
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718612941 1718612941
ci_job_id 544734802 544734802
ci_pipeline_id 36871231 36871231
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 52 metrics, 18 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:Logs Intake worse
[+23.869µs; +55.371µs] or [+7.055%; +16.366%]		 377.950µs 338.330µs
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.073 s) : 0, 1073436
Total [baseline] (10.349 s) : 0, 10349268
Agent [candidate] (1.066 s) : 0, 1065779
Total [candidate] (10.47 s) : 0, 10469960
section appsec
Agent [baseline] (1.185 s) : 0, 1184781
Total [baseline] (10.458 s) : 0, 10458229
Agent [candidate] (1.183 s) : 0, 1182652
Total [candidate] (10.446 s) : 0, 10446416
section iast
Agent [baseline] (1.172 s) : 0, 1171788
Total [baseline] (10.727 s) : 0, 10727155
Agent [candidate] (1.175 s) : 0, 1174966
Total [candidate] (10.687 s) : 0, 10686910
section profiling
Agent [baseline] (1.26 s) : 0, 1260496
Total [baseline] (10.623 s) : 0, 10623165
Agent [candidate] (1.26 s) : 0, 1260491
Total [candidate] (10.614 s) : 0, 10613634
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.073 s -
Agent appsec 1.185 s 111.345 ms (10.4%)
Agent iast 1.172 s 98.352 ms (9.2%)
Agent profiling 1.26 s 187.06 ms (17.4%)
Total tracing 10.349 s -
Total appsec 10.458 s 108.961 ms (1.1%)
Total iast 10.727 s 377.887 ms (3.7%)
Total profiling 10.623 s 273.897 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.183 s 116.873 ms (11.0%)
Agent iast 1.175 s 109.187 ms (10.2%)
Agent profiling 1.26 s 194.712 ms (18.3%)
Total tracing 10.47 s -
Total appsec 10.446 s -23.545 ms (-0.2%)
Total iast 10.687 s 216.949 ms (2.1%)
Total profiling 10.614 s 143.673 ms (1.4%) 
gantt
    title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (673.709 ms) : 0, 673709
BytebuddyAgent [candidate] (666.743 ms) : 0, 666743
GlobalTracer [baseline] (305.857 ms) : 0, 305857
GlobalTracer [candidate] (305.659 ms) : 0, 305659
AppSec [baseline] (50.489 ms) : 0, 50489
AppSec [candidate] (50.29 ms) : 0, 50290
Logs Intake [baseline] (339.084 µs) : 0, 339
Logs Intake [candidate] (411.183 µs) : 0, 411
Remote Config [baseline] (673.318 µs) : 0, 673
Remote Config [candidate] (672.915 µs) : 0, 673
Telemetry [baseline] (7.605 ms) : 0, 7605
Telemetry [candidate] (7.617 ms) : 0, 7617
section appsec
BytebuddyAgent [baseline] (677.273 ms) : 0, 677273
BytebuddyAgent [candidate] (677.905 ms) : 0, 677905
GlobalTracer [baseline] (297.141 ms) : 0, 297141
GlobalTracer [candidate] (297.529 ms) : 0, 297529
AppSec [baseline] (154.285 ms) : 0, 154285
AppSec [candidate] (153.115 ms) : 0, 153115
Logs Intake [baseline] (327.891 µs) : 0, 328
Logs Intake [candidate] (320.565 µs) : 0, 321
Remote Config [baseline] (639.26 µs) : 0, 639
Remote Config [candidate] (653.818 µs) : 0, 654
Telemetry [baseline] (9.092 ms) : 0, 9092
Telemetry [candidate] (7.542 ms) : 0, 7542
IAST [baseline] (23.13 ms) : 0, 23130
IAST [candidate] (22.23 ms) : 0, 22230
section iast
BytebuddyAgent [baseline] (780.669 ms) : 0, 780669
BytebuddyAgent [candidate] (785.357 ms) : 0, 785357
GlobalTracer [baseline] (295.05 ms) : 0, 295050
GlobalTracer [candidate] (293.657 ms) : 0, 293657
AppSec [baseline] (47.491 ms) : 0, 47491
AppSec [candidate] (46.826 ms) : 0, 46826
Logs Intake [baseline] (321.113 µs) : 0, 321
Logs Intake [candidate] (306.248 µs) : 0, 306
Remote Config [baseline] (624.659 µs) : 0, 625
Remote Config [candidate] (577.057 µs) : 0, 577
Telemetry [baseline] (9.237 ms) : 0, 9237
Telemetry [candidate] (9.322 ms) : 0, 9322
IAST [baseline] (25.142 ms) : 0, 25142
IAST [candidate] (25.548 ms) : 0, 25548
section profiling
ProfilingAgent [baseline] (95.919 ms) : 0, 95919
ProfilingAgent [candidate] (96.703 ms) : 0, 96703
BytebuddyAgent [baseline] (662.433 ms) : 0, 662433
BytebuddyAgent [candidate] (662.468 ms) : 0, 662468
GlobalTracer [baseline] (385.463 ms) : 0, 385463
GlobalTracer [candidate] (385.193 ms) : 0, 385193
AppSec [baseline] (51.485 ms) : 0, 51485
AppSec [candidate] (50.742 ms) : 0, 50742
Logs Intake [baseline] (345.163 µs) : 0, 345
Logs Intake [candidate] (333.843 µs) : 0, 334
Remote Config [baseline] (708.623 µs) : 0, 709
Remote Config [candidate] (736.727 µs) : 0, 737
Telemetry [baseline] (7.357 ms) : 0, 7357
Telemetry [candidate] (7.316 ms) : 0, 7316
Profiling [baseline] (95.943 ms) : 0, 95943
Profiling [candidate] (96.729 ms) : 0, 96729
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1064229
Total [baseline] (8.549 s) : 0, 8549308
Agent [candidate] (1.062 s) : 0, 1062401
Total [candidate] (8.558 s) : 0, 8557690
section iast
Agent [baseline] (1.173 s) : 0, 1172920
Total [baseline] (8.986 s) : 0, 8985761
Agent [candidate] (1.17 s) : 0, 1170139
Total [candidate] (9.038 s) : 0, 9037860
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.172 s) : 0, 1171770
Total [baseline] (8.957 s) : 0, 8957324
Agent [candidate] (1.165 s) : 0, 1165261
Total [candidate] (8.976 s) : 0, 8976479
section iast_TELEMETRY_OFF
Agent [baseline] (1.167 s) : 0, 1166926
Total [baseline] (9.014 s) : 0, 9013996
Agent [candidate] (1.163 s) : 0, 1163397
Total [candidate] (8.968 s) : 0, 8968457
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.173 s 108.691 ms (10.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 107.54 ms (10.1%)
Agent iast_TELEMETRY_OFF 1.167 s 102.696 ms (9.6%)
Total tracing 8.549 s -
Total iast 8.986 s 436.453 ms (5.1%)
Total iast_HARDCODED_SECRET_DISABLED 8.957 s 408.017 ms (4.8%)
Total iast_TELEMETRY_OFF 9.014 s 464.688 ms (5.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.17 s 107.738 ms (10.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.165 s 102.861 ms (9.7%)
Agent iast_TELEMETRY_OFF 1.163 s 100.997 ms (9.5%)
Total tracing 8.558 s -
Total iast 9.038 s 480.171 ms (5.6%)
Total iast_HARDCODED_SECRET_DISABLED 8.976 s 418.79 ms (4.9%)
Total iast_TELEMETRY_OFF 8.968 s 410.767 ms (4.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (666.791 ms) : 0, 666791
BytebuddyAgent [candidate] (665.679 ms) : 0, 665679
GlobalTracer [baseline] (303.863 ms) : 0, 303863
GlobalTracer [candidate] (303.565 ms) : 0, 303565
AppSec [baseline] (50.458 ms) : 0, 50458
AppSec [candidate] (50.104 ms) : 0, 50104
Logs Intake [baseline] (338.33 µs) : 0, 338
Logs Intake [candidate] (377.95 µs) : 0, 378
Remote Config [baseline] (672.508 µs) : 0, 673
Remote Config [candidate] (688.157 µs) : 0, 688
Telemetry [baseline] (7.544 ms) : 0, 7544
Telemetry [candidate] (7.495 ms) : 0, 7495
section iast
BytebuddyAgent [baseline] (784.059 ms) : 0, 784059
BytebuddyAgent [candidate] (779.651 ms) : 0, 779651
GlobalTracer [baseline] (292.973 ms) : 0, 292973
GlobalTracer [candidate] (293.767 ms) : 0, 293767
AppSec [baseline] (47.042 ms) : 0, 47042
AppSec [candidate] (46.823 ms) : 0, 46823
IAST [baseline] (27.649 ms) : 0, 27649
IAST [candidate] (27.249 ms) : 0, 27249
Logs Intake [baseline] (310.948 µs) : 0, 311
Logs Intake [candidate] (301.472 µs) : 0, 301
Remote Config [baseline] (593.227 µs) : 0, 593
Remote Config [candidate] (573.628 µs) : 0, 574
Telemetry [baseline] (6.911 ms) : 0, 6911
Telemetry [candidate] (8.438 ms) : 0, 8438
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (780.213 ms) : 0, 780213
BytebuddyAgent [candidate] (776.796 ms) : 0, 776796
GlobalTracer [baseline] (293.843 ms) : 0, 293843
GlobalTracer [candidate] (292.448 ms) : 0, 292448
AppSec [baseline] (47.406 ms) : 0, 47406
AppSec [candidate] (46.306 ms) : 0, 46306
IAST [baseline] (28.295 ms) : 0, 28295
IAST [candidate] (26.289 ms) : 0, 26289
Logs Intake [baseline] (301.012 µs) : 0, 301
Logs Intake [candidate] (308.563 µs) : 0, 309
Remote Config [baseline] (577.232 µs) : 0, 577
Remote Config [candidate] (570.594 µs) : 0, 571
Telemetry [baseline] (7.751 ms) : 0, 7751
Telemetry [candidate] (9.215 ms) : 0, 9215
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (777.427 ms) : 0, 777427
BytebuddyAgent [candidate] (776.354 ms) : 0, 776354
GlobalTracer [baseline] (293.576 ms) : 0, 293576
GlobalTracer [candidate] (293.268 ms) : 0, 293268
AppSec [baseline] (47.242 ms) : 0, 47242
AppSec [candidate] (50.143 ms) : 0, 50143
IAST [baseline] (27.531 ms) : 0, 27531
IAST [candidate] (21.825 ms) : 0, 21825
Logs Intake [baseline] (300.175 µs) : 0, 300
Logs Intake [candidate] (302.253 µs) : 0, 302
Remote Config [baseline] (576.067 µs) : 0, 576
Remote Config [candidate] (569.254 µs) : 0, 569
Telemetry [baseline] (6.907 ms) : 0, 6907
Telemetry [candidate] (7.575 ms) : 0, 7575

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-06-17T07:59:50 2024-06-17T08:06:40
git_branch master nenadnoveljic/test-branch
git_commit_date 1718392893 1718359413
git_commit_sha ecd93fb8b3 255b6a28cd
release_version 1.36.0-SNAPSHOT~ecd93fb8b3 1.36.0-SNAPSHOT~255b6a28cd
start_time 2024-06-17T07:59:36 2024-06-17T08:06:26
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1718611946 1718611946
ci_job_id 544734803 544734803
ci_pipeline_id 36871231 36871231
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (368.763 µs) : 349, 388
.   : milestone, 369,
iast (485.978 µs) : 465, 507
.   : milestone, 486,
iast_FULL (551.258 µs) : 530, 572
.   : milestone, 551,
iast_GLOBAL (503.161 µs) : 482, 524
.   : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (484.95 µs) : 464, 506
.   : milestone, 485,
iast_INACTIVE (456.261 µs) : 434, 478
.   : milestone, 456,
iast_TELEMETRY_OFF (472.828 µs) : 452, 494
.   : milestone, 473,
tracing (445.931 µs) : 425, 467
.   : milestone, 446,
section candidate
no_agent (377.22 µs) : 357, 397
.   : milestone, 377,
iast (481.992 µs) : 461, 503
.   : milestone, 482,
iast_FULL (552.299 µs) : 531, 573
.   : milestone, 552,
iast_GLOBAL (509.011 µs) : 487, 531
.   : milestone, 509,
iast_HARDCODED_SECRET_DISABLED (485.776 µs) : 464, 507
.   : milestone, 486,
iast_INACTIVE (453.169 µs) : 432, 474
.   : milestone, 453,
iast_TELEMETRY_OFF (475.194 µs) : 454, 497
.   : milestone, 475,
tracing (442.774 µs) : 422, 464
.   : milestone, 443,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.763 µs [349.299 µs, 388.227 µs] -
iast 485.978 µs [464.93 µs, 507.026 µs] 117.215 µs (31.8%)
iast_FULL 551.258 µs [530.04 µs, 572.477 µs] 182.496 µs (49.5%)
iast_GLOBAL 503.161 µs [482.033 µs, 524.289 µs] 134.398 µs (36.4%)
iast_HARDCODED_SECRET_DISABLED 484.95 µs [463.718 µs, 506.182 µs] 116.187 µs (31.5%)
iast_INACTIVE 456.261 µs [434.492 µs, 478.029 µs] 87.498 µs (23.7%)
iast_TELEMETRY_OFF 472.828 µs [451.536 µs, 494.121 µs] 104.065 µs (28.2%)
tracing 445.931 µs [424.667 µs, 467.195 µs] 77.168 µs (20.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.22 µs [357.116 µs, 397.323 µs] -
iast 481.992 µs [460.677 µs, 503.307 µs] 104.773 µs (27.8%)
iast_FULL 552.299 µs [531.157 µs, 573.441 µs] 175.079 µs (46.4%)
iast_GLOBAL 509.011 µs [486.921 µs, 531.101 µs] 131.792 µs (34.9%)
iast_HARDCODED_SECRET_DISABLED 485.776 µs [464.35 µs, 507.203 µs] 108.557 µs (28.8%)
iast_INACTIVE 453.169 µs [431.955 µs, 474.383 µs] 75.949 µs (20.1%)
iast_TELEMETRY_OFF 475.194 µs [453.614 µs, 496.774 µs] 97.975 µs (26.0%)
tracing 442.774 µs [421.982 µs, 463.566 µs] 65.554 µs (17.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.352 ms) : 1333, 1371
.   : milestone, 1352,
appsec (1.723 ms) : 1699, 1748
.   : milestone, 1723,
appsec_no_iast (1.7 ms) : 1675, 1726
.   : milestone, 1700,
iast (1.463 ms) : 1441, 1486
.   : milestone, 1463,
profiling (1.552 ms) : 1527, 1577
.   : milestone, 1552,
tracing (1.473 ms) : 1449, 1497
.   : milestone, 1473,
section candidate
no_agent (1.35 ms) : 1331, 1370
.   : milestone, 1350,
appsec (1.706 ms) : 1681, 1731
.   : milestone, 1706,
appsec_no_iast (1.732 ms) : 1707, 1756
.   : milestone, 1732,
iast (1.494 ms) : 1469, 1518
.   : milestone, 1494,
profiling (1.561 ms) : 1536, 1586
.   : milestone, 1561,
tracing (1.484 ms) : 1461, 1508
.   : milestone, 1484,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.352 ms [1.333 ms, 1.371 ms] -
appsec 1.723 ms [1.699 ms, 1.748 ms] 370.968 µs (27.4%)
appsec_no_iast 1.7 ms [1.675 ms, 1.726 ms] 348.083 µs (25.7%)
iast 1.463 ms [1.441 ms, 1.486 ms] 111.121 µs (8.2%)
profiling 1.552 ms [1.527 ms, 1.577 ms] 199.733 µs (14.8%)
tracing 1.473 ms [1.449 ms, 1.497 ms] 120.733 µs (8.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.35 ms [1.331 ms, 1.37 ms] -
appsec 1.706 ms [1.681 ms, 1.731 ms] 355.488 µs (26.3%)
appsec_no_iast 1.732 ms [1.707 ms, 1.756 ms] 381.412 µs (28.3%)
iast 1.494 ms [1.469 ms, 1.518 ms] 143.388 µs (10.6%)
profiling 1.561 ms [1.536 ms, 1.586 ms] 210.978 µs (15.6%)
tracing 1.484 ms [1.461 ms, 1.508 ms] 134.096 µs (9.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nenadnoveljic/test-branch
git_commit_date 1718392893 1718359413
git_commit_sha ecd93fb8b3 255b6a28cd
release_version 1.36.0-SNAPSHOT~ecd93fb8b3 1.36.0-SNAPSHOT~255b6a28cd
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1718612443 1718612443
ci_job_id 544734804 544734804
ci_pipeline_id 36871231 36871231
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.433 s) : 15433000, 15433000
.   : milestone, 15433000,
appsec (15.177 s) : 15177000, 15177000
.   : milestone, 15177000,
iast (18.786 s) : 18786000, 18786000
.   : milestone, 18786000,
iast_GLOBAL (18.05 s) : 18050000, 18050000
.   : milestone, 18050000,
profiling (15.72 s) : 15720000, 15720000
.   : milestone, 15720000,
tracing (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
section candidate
no_agent (14.945 s) : 14945000, 14945000
.   : milestone, 14945000,
appsec (14.805 s) : 14805000, 14805000
.   : milestone, 14805000,
iast (18.767 s) : 18767000, 18767000
.   : milestone, 18767000,
iast_GLOBAL (17.822 s) : 17822000, 17822000
.   : milestone, 17822000,
profiling (15.697 s) : 15697000, 15697000
.   : milestone, 15697000,
tracing (15.192 s) : 15192000, 15192000
.   : milestone, 15192000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.433 s [15.433 s, 15.433 s] -
appsec 15.177 s [15.177 s, 15.177 s] -256.0 ms (-1.7%)
iast 18.786 s [18.786 s, 18.786 s] 3.353 s (21.7%)
iast_GLOBAL 18.05 s [18.05 s, 18.05 s] 2.617 s (17.0%)
profiling 15.72 s [15.72 s, 15.72 s] 287.0 ms (1.9%)
tracing 15.036 s [15.036 s, 15.036 s] -397.0 ms (-2.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.945 s [14.945 s, 14.945 s] -
appsec 14.805 s [14.805 s, 14.805 s] -140.0 ms (-0.9%)
iast 18.767 s [18.767 s, 18.767 s] 3.822 s (25.6%)
iast_GLOBAL 17.822 s [17.822 s, 17.822 s] 2.877 s (19.3%)
profiling 15.697 s [15.697 s, 15.697 s] 752.0 ms (5.0%)
tracing 15.192 s [15.192 s, 15.192 s] 247.0 ms (1.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~255b6a28cd, baseline=1.36.0-SNAPSHOT~ecd93fb8b3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.454 ms) : 1442, 1465
.   : milestone, 1454,
appsec (2.194 ms) : 2160, 2228
.   : milestone, 2194,
iast (1.959 ms) : 1918, 2001
.   : milestone, 1959,
iast_GLOBAL (2.001 ms) : 1960, 2043
.   : milestone, 2001,
profiling (1.847 ms) : 1814, 1880
.   : milestone, 1847,
tracing (1.818 ms) : 1786, 1849
.   : milestone, 1818,
section candidate
no_agent (1.461 ms) : 1450, 1472
.   : milestone, 1461,
appsec (2.193 ms) : 2159, 2227
.   : milestone, 2193,
iast (1.956 ms) : 1915, 1997
.   : milestone, 1956,
iast_GLOBAL (1.978 ms) : 1938, 2018
.   : milestone, 1978,
profiling (1.856 ms) : 1822, 1890
.   : milestone, 1856,
tracing (1.828 ms) : 1796, 1860
.   : milestone, 1828,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.454 ms [1.442 ms, 1.465 ms] -
appsec 2.194 ms [2.16 ms, 2.228 ms] 740.102 µs (50.9%)
iast 1.959 ms [1.918 ms, 2.001 ms] 505.406 µs (34.8%)
iast_GLOBAL 2.001 ms [1.96 ms, 2.043 ms] 547.35 µs (37.7%)
profiling 1.847 ms [1.814 ms, 1.88 ms] 393.663 µs (27.1%)
tracing 1.818 ms [1.786 ms, 1.849 ms] 363.791 µs (25.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.461 ms [1.45 ms, 1.472 ms] -
appsec 2.193 ms [2.159 ms, 2.227 ms] 731.975 µs (50.1%)
iast 1.956 ms [1.915 ms, 1.997 ms] 494.653 µs (33.9%)
iast_GLOBAL 1.978 ms [1.938 ms, 2.018 ms] 517.192 µs (35.4%)
profiling 1.856 ms [1.822 ms, 1.89 ms] 395.073 µs (27.0%)
tracing 1.828 ms [1.796 ms, 1.86 ms] 367.222 µs (25.1%)

pr-commenter[bot] avatar Jun 17 '24 07:06 pr-commenter[bot]