dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

Support Json Schema tracking

Open nayeem-kamal opened this issue 1 year ago • 1 comments

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

nayeem-kamal avatar Aug 26 '24 18:08 nayeem-kamal

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/jackson-schema-tracking
git_commit_date 1724688479 1724698172
git_commit_sha 445bbe4ef8 2d8bf34427
release_version 1.39.0-SNAPSHOT~445bbe4ef8 1.39.0-SNAPSHOT~2d8bf34427
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724700655 1724700655
ci_job_id 617532361 617532361
ci_pipeline_id 42855057 42855057
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 4 performance improvements and 0 performance regressions! Performance is the same for 41 metrics, 18 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:AppSec better
[-2.029ms; -1.247ms] or [-3.954%; -2.430%]
49.685ms 51.323ms
scenario:startup:petclinic:appsec:AppSec better
[-10.019ms; -6.780ms] or [-6.295%; -4.260%]
150.759ms 159.159ms
scenario:startup:petclinic:profiling:ProfilingAgent better
[-9.377ms; -3.611ms] or [-9.718%; -3.742%]
90.000ms 96.494ms
scenario:startup:petclinic:profiling:Profiling better
[-9.379ms; -3.612ms] or [-9.717%; -3.742%]
90.024ms 96.519ms
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~2d8bf34427, baseline=1.39.0-SNAPSHOT~445bbe4ef8

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1045816
Total [baseline] (10.469 s) : 0, 10469447
Agent [candidate] (1.05 s) : 0, 1050233
Total [candidate] (10.275 s) : 0, 10275451
section appsec
Agent [baseline] (1.169 s) : 0, 1169008
Total [baseline] (10.434 s) : 0, 10434145
Agent [candidate] (1.168 s) : 0, 1168091
Total [candidate] (10.436 s) : 0, 10436067
section iast
Agent [baseline] (1.17 s) : 0, 1170274
Total [baseline] (10.803 s) : 0, 10802879
Agent [candidate] (1.187 s) : 0, 1187343
Total [candidate] (10.836 s) : 0, 10835547
section profiling
Agent [baseline] (1.254 s) : 0, 1253659
Total [baseline] (10.602 s) : 0, 10602462
Agent [candidate] (1.247 s) : 0, 1247074
Total [candidate] (10.605 s) : 0, 10604718
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent appsec 1.169 s 123.191 ms (11.8%)
Agent iast 1.17 s 124.458 ms (11.9%)
Agent profiling 1.254 s 207.842 ms (19.9%)
Total tracing 10.469 s -
Total appsec 10.434 s -35.303 ms (-0.3%)
Total iast 10.803 s 333.432 ms (3.2%)
Total profiling 10.602 s 133.015 ms (1.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent appsec 1.168 s 117.859 ms (11.2%)
Agent iast 1.187 s 137.11 ms (13.1%)
Agent profiling 1.247 s 196.841 ms (18.7%)
Total tracing 10.275 s -
Total appsec 10.436 s 160.616 ms (1.6%)
Total iast 10.836 s 560.096 ms (5.5%)
Total profiling 10.605 s 329.267 ms (3.2%)
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~2d8bf34427, baseline=1.39.0-SNAPSHOT~445bbe4ef8

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (667.019 ms) : 0, 667019
BytebuddyAgent [candidate] (674.055 ms) : 0, 674055
GlobalTracer [baseline] (305.844 ms) : 0, 305844
GlobalTracer [candidate] (304.399 ms) : 0, 304399
AppSec [baseline] (51.368 ms) : 0, 51368
AppSec [candidate] (50.264 ms) : 0, 50264
Remote Config [baseline] (666.072 µs) : 0, 666
Remote Config [candidate] (678.494 µs) : 0, 678
Telemetry [baseline] (7.426 ms) : 0, 7426
Telemetry [candidate] (7.382 ms) : 0, 7382
section appsec
BytebuddyAgent [baseline] (679.387 ms) : 0, 679387
BytebuddyAgent [candidate] (685.059 ms) : 0, 685059
GlobalTracer [baseline] (299.567 ms) : 0, 299567
GlobalTracer [candidate] (298.573 ms) : 0, 298573
AppSec [baseline] (159.159 ms) : 0, 159159
AppSec [candidate] (150.759 ms) : 0, 150759
Remote Config [baseline] (625.696 µs) : 0, 626
Remote Config [candidate] (600.214 µs) : 0, 600
Telemetry [baseline] (7.442 ms) : 0, 7442
Telemetry [candidate] (8.166 ms) : 0, 8166
IAST [baseline] (18.504 ms) : 0, 18504
IAST [candidate] (22.881 ms) : 0, 22881
section iast
BytebuddyAgent [baseline] (777.082 ms) : 0, 777082
BytebuddyAgent [candidate] (794.406 ms) : 0, 794406
GlobalTracer [baseline] (295.542 ms) : 0, 295542
GlobalTracer [candidate] (295.845 ms) : 0, 295845
AppSec [baseline] (50.185 ms) : 0, 50185
AppSec [candidate] (47.874 ms) : 0, 47874
Remote Config [baseline] (599.992 µs) : 0, 600
Remote Config [candidate] (597.983 µs) : 0, 598
Telemetry [baseline] (10.44 ms) : 0, 10440
Telemetry [candidate] (11.054 ms) : 0, 11054
IAST [baseline] (22.899 ms) : 0, 22899
IAST [candidate] (24.016 ms) : 0, 24016
section profiling
ProfilingAgent [baseline] (96.494 ms) : 0, 96494
ProfilingAgent [candidate] (90.0 ms) : 0, 90000
BytebuddyAgent [baseline] (667.818 ms) : 0, 667818
BytebuddyAgent [candidate] (669.321 ms) : 0, 669321
GlobalTracer [baseline] (391.119 ms) : 0, 391119
GlobalTracer [candidate] (387.649 ms) : 0, 387649
AppSec [baseline] (52.543 ms) : 0, 52543
AppSec [candidate] (51.066 ms) : 0, 51066
Remote Config [baseline] (691.145 µs) : 0, 691
Remote Config [candidate] (699.678 µs) : 0, 700
Telemetry [baseline] (7.4 ms) : 0, 7400
Telemetry [candidate] (11.225 ms) : 0, 11225
Profiling [baseline] (96.519 ms) : 0, 96519
Profiling [candidate] (90.024 ms) : 0, 90024
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~2d8bf34427, baseline=1.39.0-SNAPSHOT~445bbe4ef8

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.048 s) : 0, 1047812
Total [baseline] (8.479 s) : 0, 8479357
Agent [candidate] (1.046 s) : 0, 1046163
Total [candidate] (8.465 s) : 0, 8465041
section iast
Agent [baseline] (1.174 s) : 0, 1174009
Total [baseline] (8.929 s) : 0, 8929149
Agent [candidate] (1.18 s) : 0, 1179885
Total [candidate] (8.964 s) : 0, 8964122
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.171 s) : 0, 1170975
Total [baseline] (8.948 s) : 0, 8947914
Agent [candidate] (1.175 s) : 0, 1174509
Total [candidate] (8.903 s) : 0, 8902730
section iast_TELEMETRY_OFF
Agent [baseline] (1.165 s) : 0, 1164627
Total [baseline] (8.923 s) : 0, 8922998
Agent [candidate] (1.197 s) : 0, 1196600
Total [candidate] (9.0 s) : 0, 8999520
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent iast 1.174 s 126.197 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 123.164 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.165 s 116.815 ms (11.1%)
Total tracing 8.479 s -
Total iast 8.929 s 449.792 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.948 s 468.556 ms (5.5%)
Total iast_TELEMETRY_OFF 8.923 s 443.641 ms (5.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent iast 1.18 s 133.722 ms (12.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.175 s 128.346 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.197 s 150.437 ms (14.4%)
Total tracing 8.465 s -
Total iast 8.964 s 499.081 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 8.903 s 437.688 ms (5.2%)
Total iast_TELEMETRY_OFF 9.0 s 534.479 ms (6.3%)
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~2d8bf34427, baseline=1.39.0-SNAPSHOT~445bbe4ef8

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (668.74 ms) : 0, 668740
BytebuddyAgent [candidate] (671.963 ms) : 0, 671963
GlobalTracer [baseline] (306.092 ms) : 0, 306092
GlobalTracer [candidate] (303.196 ms) : 0, 303196
AppSec [baseline] (51.323 ms) : 0, 51323
AppSec [candidate] (49.685 ms) : 0, 49685
Remote Config [baseline] (666.038 µs) : 0, 666
Remote Config [candidate] (663.759 µs) : 0, 664
Telemetry [baseline] (7.452 ms) : 0, 7452
Telemetry [candidate] (7.247 ms) : 0, 7247
section iast
BytebuddyAgent [baseline] (780.75 ms) : 0, 780750
BytebuddyAgent [candidate] (789.687 ms) : 0, 789687
GlobalTracer [baseline] (295.335 ms) : 0, 295335
GlobalTracer [candidate] (293.479 ms) : 0, 293479
AppSec [baseline] (50.0 ms) : 0, 50000
AppSec [candidate] (49.934 ms) : 0, 49934
IAST [baseline] (24.999 ms) : 0, 24999
IAST [candidate] (25.026 ms) : 0, 25026
Remote Config [baseline] (592.775 µs) : 0, 593
Remote Config [candidate] (591.519 µs) : 0, 592
Telemetry [baseline] (8.703 ms) : 0, 8703
Telemetry [candidate] (7.672 ms) : 0, 7672
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (777.948 ms) : 0, 777948
BytebuddyAgent [candidate] (785.4 ms) : 0, 785400
GlobalTracer [baseline] (295.556 ms) : 0, 295556
GlobalTracer [candidate] (293.599 ms) : 0, 293599
AppSec [baseline] (48.93 ms) : 0, 48930
AppSec [candidate] (51.316 ms) : 0, 51316
IAST [baseline] (26.435 ms) : 0, 26435
IAST [candidate] (21.68 ms) : 0, 21680
Remote Config [baseline] (593.85 µs) : 0, 594
Remote Config [candidate] (579.603 µs) : 0, 580
Telemetry [baseline] (7.945 ms) : 0, 7945
Telemetry [candidate] (8.449 ms) : 0, 8449
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (772.281 ms) : 0, 772281
BytebuddyAgent [candidate] (801.28 ms) : 0, 801280
GlobalTracer [baseline] (295.086 ms) : 0, 295086
GlobalTracer [candidate] (299.285 ms) : 0, 299285
AppSec [baseline] (50.838 ms) : 0, 50838
AppSec [candidate] (50.501 ms) : 0, 50501
IAST [baseline] (23.855 ms) : 0, 23855
IAST [candidate] (24.191 ms) : 0, 24191
Remote Config [baseline] (588.507 µs) : 0, 589
Remote Config [candidate] (617.465 µs) : 0, 617
Telemetry [baseline] (8.489 ms) : 0, 8489
Telemetry [candidate] (6.98 ms) : 0, 6980

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-26T19:01:45 2024-08-26T19:08:34
git_branch master nayeem-kamal/jackson-schema-tracking
git_commit_date 1724688479 1724698172
git_commit_sha 445bbe4ef8 2d8bf34427
release_version 1.39.0-SNAPSHOT~445bbe4ef8 1.39.0-SNAPSHOT~2d8bf34427
start_time 2024-08-26T19:01:32 2024-08-26T19:08:20
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724699658 1724699658
ci_job_id 617532362 617532362
ci_pipeline_id 42855057 42855057
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~2d8bf34427, baseline=1.39.0-SNAPSHOT~445bbe4ef8
    dateFormat X
    axisFormat %s
section baseline
no_agent (369.717 µs) : 350, 389
.   : milestone, 370,
iast (476.436 µs) : 454, 499
.   : milestone, 476,
iast_FULL (551.59 µs) : 530, 574
.   : milestone, 552,
iast_GLOBAL (507.359 µs) : 486, 529
.   : milestone, 507,
iast_HARDCODED_SECRET_DISABLED (483.015 µs) : 461, 505
.   : milestone, 483,
iast_INACTIVE (445.679 µs) : 425, 466
.   : milestone, 446,
iast_TELEMETRY_OFF (472.99 µs) : 451, 495
.   : milestone, 473,
tracing (442.848 µs) : 423, 463
.   : milestone, 443,
section candidate
no_agent (373.397 µs) : 354, 393
.   : milestone, 373,
iast (477.558 µs) : 457, 498
.   : milestone, 478,
iast_FULL (547.982 µs) : 527, 569
.   : milestone, 548,
iast_GLOBAL (504.482 µs) : 483, 526
.   : milestone, 504,
iast_HARDCODED_SECRET_DISABLED (488.073 µs) : 467, 510
.   : milestone, 488,
iast_INACTIVE (452.088 µs) : 430, 474
.   : milestone, 452,
iast_TELEMETRY_OFF (471.539 µs) : 450, 493
.   : milestone, 472,
tracing (438.416 µs) : 418, 459
.   : milestone, 438,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 369.717 µs [350.211 µs, 389.223 µs] -
iast 476.436 µs [454.002 µs, 498.871 µs] 106.72 µs (28.9%)
iast_FULL 551.59 µs [529.662 µs, 573.519 µs] 181.874 µs (49.2%)
iast_GLOBAL 507.359 µs [486.167 µs, 528.55 µs] 137.642 µs (37.2%)
iast_HARDCODED_SECRET_DISABLED 483.015 µs [460.889 µs, 505.141 µs] 113.299 µs (30.6%)
iast_INACTIVE 445.679 µs [424.896 µs, 466.463 µs] 75.962 µs (20.5%)
iast_TELEMETRY_OFF 472.99 µs [450.747 µs, 495.233 µs] 103.273 µs (27.9%)
tracing 442.848 µs [422.634 µs, 463.061 µs] 73.131 µs (19.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.397 µs [353.998 µs, 392.795 µs] -
iast 477.558 µs [456.809 µs, 498.307 µs] 104.161 µs (27.9%)
iast_FULL 547.982 µs [527.012 µs, 568.952 µs] 174.585 µs (46.8%)
iast_GLOBAL 504.482 µs [483.144 µs, 525.82 µs] 131.085 µs (35.1%)
iast_HARDCODED_SECRET_DISABLED 488.073 µs [466.584 µs, 509.563 µs] 114.677 µs (30.7%)
iast_INACTIVE 452.088 µs [430.317 µs, 473.859 µs] 78.691 µs (21.1%)
iast_TELEMETRY_OFF 471.539 µs [450.049 µs, 493.029 µs] 98.143 µs (26.3%)
tracing 438.416 µs [417.669 µs, 459.163 µs] 65.019 µs (17.4%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~2d8bf34427, baseline=1.39.0-SNAPSHOT~445bbe4ef8
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.337 ms) : 1318, 1356
.   : milestone, 1337,
appsec (1.737 ms) : 1714, 1760
.   : milestone, 1737,
appsec_no_iast (1.741 ms) : 1717, 1765
.   : milestone, 1741,
iast (1.464 ms) : 1442, 1486
.   : milestone, 1464,
profiling (1.483 ms) : 1460, 1506
.   : milestone, 1483,
tracing (1.459 ms) : 1435, 1483
.   : milestone, 1459,
section candidate
no_agent (1.344 ms) : 1325, 1363
.   : milestone, 1344,
appsec (1.712 ms) : 1689, 1734
.   : milestone, 1712,
appsec_no_iast (1.746 ms) : 1721, 1770
.   : milestone, 1746,
iast (1.482 ms) : 1460, 1504
.   : milestone, 1482,
profiling (1.486 ms) : 1462, 1511
.   : milestone, 1486,
tracing (1.444 ms) : 1419, 1468
.   : milestone, 1444,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.337 ms [1.318 ms, 1.356 ms] -
appsec 1.737 ms [1.714 ms, 1.76 ms] 399.921 µs (29.9%)
appsec_no_iast 1.741 ms [1.717 ms, 1.765 ms] 404.023 µs (30.2%)
iast 1.464 ms [1.442 ms, 1.486 ms] 127.006 µs (9.5%)
profiling 1.483 ms [1.46 ms, 1.506 ms] 145.759 µs (10.9%)
tracing 1.459 ms [1.435 ms, 1.483 ms] 121.628 µs (9.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.344 ms [1.325 ms, 1.363 ms] -
appsec 1.712 ms [1.689 ms, 1.734 ms] 367.782 µs (27.4%)
appsec_no_iast 1.746 ms [1.721 ms, 1.77 ms] 401.9 µs (29.9%)
iast 1.482 ms [1.46 ms, 1.504 ms] 138.399 µs (10.3%)
profiling 1.486 ms [1.462 ms, 1.511 ms] 142.406 µs (10.6%)
tracing 1.444 ms [1.419 ms, 1.468 ms] 99.966 µs (7.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/jackson-schema-tracking
git_commit_date 1724688479 1724698172
git_commit_sha 445bbe4ef8 2d8bf34427
release_version 1.39.0-SNAPSHOT~445bbe4ef8 1.39.0-SNAPSHOT~2d8bf34427
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1724700165 1724700165
ci_job_id 617532363 617532363
ci_pipeline_id 42855057 42855057
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:iast_GLOBAL better
[-201.216µs; -106.942µs] or [-9.325%; -4.956%]
2.004ms 2.158ms
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~2d8bf34427, baseline=1.39.0-SNAPSHOT~445bbe4ef8
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.451 ms) : 1440, 1462
.   : milestone, 1451,
appsec (2.222 ms) : 2186, 2257
.   : milestone, 2222,
iast (1.961 ms) : 1918, 2004
.   : milestone, 1961,
iast_GLOBAL (2.158 ms) : 2114, 2202
.   : milestone, 2158,
profiling (1.84 ms) : 1806, 1873
.   : milestone, 1840,
tracing (1.833 ms) : 1800, 1866
.   : milestone, 1833,
section candidate
no_agent (1.453 ms) : 1442, 1465
.   : milestone, 1453,
appsec (2.201 ms) : 2166, 2235
.   : milestone, 2201,
iast (1.962 ms) : 1920, 2005
.   : milestone, 1962,
iast_GLOBAL (2.004 ms) : 1961, 2047
.   : milestone, 2004,
profiling (1.855 ms) : 1820, 1889
.   : milestone, 1855,
tracing (1.825 ms) : 1792, 1857
.   : milestone, 1825,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.451 ms [1.44 ms, 1.462 ms] -
appsec 2.222 ms [2.186 ms, 2.257 ms] 770.668 µs (53.1%)
iast 1.961 ms [1.918 ms, 2.004 ms] 510.015 µs (35.2%)
iast_GLOBAL 2.158 ms [2.114 ms, 2.202 ms] 707.011 µs (48.7%)
profiling 1.84 ms [1.806 ms, 1.873 ms] 388.675 µs (26.8%)
tracing 1.833 ms [1.8 ms, 1.866 ms] 382.547 µs (26.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.453 ms [1.442 ms, 1.465 ms] -
appsec 2.201 ms [2.166 ms, 2.235 ms] 747.42 µs (51.4%)
iast 1.962 ms [1.92 ms, 2.005 ms] 508.966 µs (35.0%)
iast_GLOBAL 2.004 ms [1.961 ms, 2.047 ms] 550.506 µs (37.9%)
profiling 1.855 ms [1.82 ms, 1.889 ms] 401.322 µs (27.6%)
tracing 1.825 ms [1.792 ms, 1.857 ms] 371.284 µs (25.5%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~2d8bf34427, baseline=1.39.0-SNAPSHOT~445bbe4ef8
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.93 s) : 14930000, 14930000
.   : milestone, 14930000,
appsec (15.117 s) : 15117000, 15117000
.   : milestone, 15117000,
iast (18.891 s) : 18891000, 18891000
.   : milestone, 18891000,
iast_GLOBAL (17.95 s) : 17950000, 17950000
.   : milestone, 17950000,
profiling (15.282 s) : 15282000, 15282000
.   : milestone, 15282000,
tracing (15.139 s) : 15139000, 15139000
.   : milestone, 15139000,
section candidate
no_agent (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
appsec (15.081 s) : 15081000, 15081000
.   : milestone, 15081000,
iast (19.013 s) : 19013000, 19013000
.   : milestone, 19013000,
iast_GLOBAL (17.947 s) : 17947000, 17947000
.   : milestone, 17947000,
profiling (15.381 s) : 15381000, 15381000
.   : milestone, 15381000,
tracing (15.339 s) : 15339000, 15339000
.   : milestone, 15339000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.93 s [14.93 s, 14.93 s] -
appsec 15.117 s [15.117 s, 15.117 s] 187.0 ms (1.3%)
iast 18.891 s [18.891 s, 18.891 s] 3.961 s (26.5%)
iast_GLOBAL 17.95 s [17.95 s, 17.95 s] 3.02 s (20.2%)
profiling 15.282 s [15.282 s, 15.282 s] 352.0 ms (2.4%)
tracing 15.139 s [15.139 s, 15.139 s] 209.0 ms (1.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.01 s [15.01 s, 15.01 s] -
appsec 15.081 s [15.081 s, 15.081 s] 71.0 ms (0.5%)
iast 19.013 s [19.013 s, 19.013 s] 4.003 s (26.7%)
iast_GLOBAL 17.947 s [17.947 s, 17.947 s] 2.937 s (19.6%)
profiling 15.381 s [15.381 s, 15.381 s] 371.0 ms (2.5%)
tracing 15.339 s [15.339 s, 15.339 s] 329.0 ms (2.2%)

pr-commenter[bot] avatar Aug 26 '24 19:08 pr-commenter[bot]

This pull request has been marked as stale because it has not had activity over the past quarter. It will be closed in 7 days if no further activity occurs. Feel free to reopen the PR if you are still working on it.

github-actions[bot] avatar Dec 01 '24 03:12 github-actions[bot]

This pull request has been closed because it has not had activity over the past quarter. Feel free to reopen the PR if you are still working on it.

github-actions[bot] avatar Jan 01 '25 03:01 github-actions[bot]