dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

Inject trace context into AWS Step Functions input

Open DylanLovesCoffee opened this issue 1 year ago • 2 comments

What Does This Do

Adds an instrumentation for AWS SDK Step Functions. This enables tracing for when a Lambda function invokes a Step Function. Trace context is injected into the Step Function's StartExecutionRequest/StartSyncExecutionRequest.Input object.

Example of traced step function in the Serverless org: app

The Logs to Traces Reducer will read the trace context from the Step Function logs and create a span for the Step Function.

Motivation

Continues the work done in Python and NodeJS.

Additional Notes

Screenshots of feature: sfn-exec sfn-sync-exec

Contributor Checklist

Jira ticket: [SVLS-5249](https://datadoghq.atlassian.net/browse/SVLS-5249)

DylanLovesCoffee avatar Sep 09 '24 15:09 DylanLovesCoffee

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dylan/sfn-trace-ctx
git_commit_date 1739895801 1739897266
git_commit_sha 0ba7b76f47 0f304c70e2
release_version 1.47.0-SNAPSHOT~0ba7b76f47 1.47.0-SNAPSHOT~0f304c70e2
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739899723 1739899723
ci_job_id 812393942 812393942
ci_pipeline_id 56180929 56180929
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-pf96l-bk-project-304-concurrent-0-gjr7nd5n 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-pf96l-bk-project-304-concurrent-0-gjr7nd5n 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~0f304c70e2, baseline=1.47.0-SNAPSHOT~0ba7b76f47

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1046545
Total [baseline] (10.481 s) : 0, 10480652
Agent [candidate] (1.039 s) : 0, 1039401
Total [candidate] (10.404 s) : 0, 10404299
section appsec
Agent [baseline] (1.19 s) : 0, 1190476
Total [baseline] (10.77 s) : 0, 10770225
Agent [candidate] (1.186 s) : 0, 1186132
Total [candidate] (10.793 s) : 0, 10792992
section iast
Agent [baseline] (1.178 s) : 0, 1178280
Total [baseline] (11.118 s) : 0, 11117690
Agent [candidate] (1.177 s) : 0, 1177372
Total [candidate] (11.072 s) : 0, 11072120
section profiling
Agent [baseline] (1.267 s) : 0, 1266717
Total [baseline] (10.897 s) : 0, 10897019
Agent [candidate] (1.273 s) : 0, 1273115
Total [candidate] (10.942 s) : 0, 10942347
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.19 s 143.931 ms (13.8%)
Agent iast 1.178 s 131.735 ms (12.6%)
Agent profiling 1.267 s 220.172 ms (21.0%)
Total tracing 10.481 s -
Total appsec 10.77 s 289.573 ms (2.8%)
Total iast 11.118 s 637.038 ms (6.1%)
Total profiling 10.897 s 416.367 ms (4.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.039 s -
Agent appsec 1.186 s 146.731 ms (14.1%)
Agent iast 1.177 s 137.971 ms (13.3%)
Agent profiling 1.273 s 233.714 ms (22.5%)
Total tracing 10.404 s -
Total appsec 10.793 s 388.694 ms (3.7%)
Total iast 11.072 s 667.822 ms (6.4%)
Total profiling 10.942 s 538.048 ms (5.2%)
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~0f304c70e2, baseline=1.47.0-SNAPSHOT~0ba7b76f47

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (722.382 ms) : 0, 722382
BytebuddyAgent [candidate] (716.243 ms) : 0, 716243
GlobalTracer [baseline] (240.886 ms) : 0, 240886
GlobalTracer [candidate] (239.144 ms) : 0, 239144
AppSec [baseline] (55.76 ms) : 0, 55760
AppSec [candidate] (55.169 ms) : 0, 55169
Remote Config [baseline] (706.304 µs) : 0, 706
Remote Config [candidate] (699.777 µs) : 0, 700
Telemetry [baseline] (11.489 ms) : 0, 11489
Telemetry [candidate] (12.98 ms) : 0, 12980
section appsec
BytebuddyAgent [baseline] (739.239 ms) : 0, 739239
BytebuddyAgent [candidate] (736.343 ms) : 0, 736343
GlobalTracer [baseline] (238.36 ms) : 0, 238360
GlobalTracer [candidate] (236.875 ms) : 0, 236875
AppSec [baseline] (177.686 ms) : 0, 177686
AppSec [candidate] (177.874 ms) : 0, 177874
Remote Config [baseline] (677.253 µs) : 0, 677
Remote Config [candidate] (659.977 µs) : 0, 660
Telemetry [baseline] (8.301 ms) : 0, 8301
Telemetry [candidate] (8.268 ms) : 0, 8268
IAST [baseline] (21.728 ms) : 0, 21728
IAST [candidate] (21.623 ms) : 0, 21623
section iast
BytebuddyAgent [baseline] (841.327 ms) : 0, 841327
BytebuddyAgent [candidate] (839.209 ms) : 0, 839209
GlobalTracer [baseline] (231.326 ms) : 0, 231326
GlobalTracer [candidate] (232.179 ms) : 0, 232179
AppSec [baseline] (57.754 ms) : 0, 57754
AppSec [candidate] (57.894 ms) : 0, 57894
Remote Config [baseline] (617.929 µs) : 0, 618
Remote Config [candidate] (627.842 µs) : 0, 628
Telemetry [baseline] (8.77 ms) : 0, 8770
Telemetry [candidate] (8.888 ms) : 0, 8888
IAST [baseline] (23.008 ms) : 0, 23008
IAST [candidate] (23.321 ms) : 0, 23321
section profiling
ProfilingAgent [baseline] (96.867 ms) : 0, 96867
ProfilingAgent [candidate] (97.644 ms) : 0, 97644
BytebuddyAgent [baseline] (710.447 ms) : 0, 710447
BytebuddyAgent [candidate] (715.131 ms) : 0, 715131
GlobalTracer [baseline] (351.783 ms) : 0, 351783
GlobalTracer [candidate] (352.779 ms) : 0, 352779
AppSec [baseline] (55.592 ms) : 0, 55592
AppSec [candidate] (54.898 ms) : 0, 54898
Remote Config [baseline] (682.048 µs) : 0, 682
Remote Config [candidate] (681.871 µs) : 0, 682
Telemetry [baseline] (8.968 ms) : 0, 8968
Telemetry [candidate] (9.046 ms) : 0, 9046
Profiling [baseline] (96.891 ms) : 0, 96891
Profiling [candidate] (97.668 ms) : 0, 97668
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~0f304c70e2, baseline=1.47.0-SNAPSHOT~0ba7b76f47

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1043443
Total [baseline] (8.641 s) : 0, 8640975
Agent [candidate] (1.04 s) : 0, 1040116
Total [candidate] (8.626 s) : 0, 8625758
section iast
Agent [baseline] (1.17 s) : 0, 1170028
Total [baseline] (9.277 s) : 0, 9277333
Agent [candidate] (1.177 s) : 0, 1177434
Total [candidate] (9.328 s) : 0, 9328304
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.171 s) : 0, 1170831
Total [baseline] (9.274 s) : 0, 9274286
Agent [candidate] (1.171 s) : 0, 1170518
Total [candidate] (9.213 s) : 0, 9213331
section iast_TELEMETRY_OFF
Agent [baseline] (1.165 s) : 0, 1165307
Total [baseline] (9.22 s) : 0, 9220210
Agent [candidate] (1.167 s) : 0, 1166916
Total [candidate] (9.26 s) : 0, 9260403
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent iast 1.17 s 126.585 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 127.387 ms (12.2%)
Agent iast_TELEMETRY_OFF 1.165 s 121.863 ms (11.7%)
Total tracing 8.641 s -
Total iast 9.277 s 636.358 ms (7.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.274 s 633.312 ms (7.3%)
Total iast_TELEMETRY_OFF 9.22 s 579.235 ms (6.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent iast 1.177 s 137.318 ms (13.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 130.402 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.167 s 126.8 ms (12.2%)
Total tracing 8.626 s -
Total iast 9.328 s 702.546 ms (8.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.213 s 587.573 ms (6.8%)
Total iast_TELEMETRY_OFF 9.26 s 634.645 ms (7.4%)
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~0f304c70e2, baseline=1.47.0-SNAPSHOT~0ba7b76f47

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.209 ms) : 0, 718209
BytebuddyAgent [candidate] (717.201 ms) : 0, 717201
GlobalTracer [baseline] (240.21 ms) : 0, 240210
GlobalTracer [candidate] (239.43 ms) : 0, 239430
AppSec [baseline] (56.256 ms) : 0, 56256
AppSec [candidate] (55.421 ms) : 0, 55421
Remote Config [baseline] (695.784 µs) : 0, 696
Remote Config [candidate] (692.699 µs) : 0, 693
Telemetry [baseline] (12.872 ms) : 0, 12872
Telemetry [candidate] (12.18 ms) : 0, 12180
section iast
BytebuddyAgent [baseline] (834.498 ms) : 0, 834498
BytebuddyAgent [candidate] (840.02 ms) : 0, 840020
GlobalTracer [baseline] (230.838 ms) : 0, 230838
GlobalTracer [candidate] (232.267 ms) : 0, 232267
IAST [baseline] (22.795 ms) : 0, 22795
IAST [candidate] (22.961 ms) : 0, 22961
AppSec [baseline] (57.255 ms) : 0, 57255
AppSec [candidate] (57.49 ms) : 0, 57490
Remote Config [baseline] (619.376 µs) : 0, 619
Remote Config [candidate] (618.436 µs) : 0, 618
Telemetry [baseline] (8.712 ms) : 0, 8712
Telemetry [candidate] (8.779 ms) : 0, 8779
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (834.413 ms) : 0, 834413
BytebuddyAgent [candidate] (835.558 ms) : 0, 835558
GlobalTracer [baseline] (230.972 ms) : 0, 230972
GlobalTracer [candidate] (230.506 ms) : 0, 230506
IAST [baseline] (22.932 ms) : 0, 22932
IAST [candidate] (22.723 ms) : 0, 22723
AppSec [baseline] (57.811 ms) : 0, 57811
AppSec [candidate] (57.174 ms) : 0, 57174
Remote Config [baseline] (619.165 µs) : 0, 619
Remote Config [candidate] (599.033 µs) : 0, 599
Telemetry [baseline] (8.861 ms) : 0, 8861
Telemetry [candidate] (8.629 ms) : 0, 8629
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (831.665 ms) : 0, 831665
BytebuddyAgent [candidate] (833.126 ms) : 0, 833126
GlobalTracer [baseline] (229.675 ms) : 0, 229675
GlobalTracer [candidate] (229.83 ms) : 0, 229830
IAST [baseline] (25.483 ms) : 0, 25483
IAST [candidate] (23.625 ms) : 0, 23625
AppSec [baseline] (54.02 ms) : 0, 54020
AppSec [candidate] (55.773 ms) : 0, 55773
Remote Config [baseline] (630.322 µs) : 0, 630
Remote Config [candidate] (615.01 µs) : 0, 615
Telemetry [baseline] (8.6 ms) : 0, 8600
Telemetry [candidate] (8.644 ms) : 0, 8644

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-18T16:58:35 2025-02-18T17:05:39
git_branch master dylan/sfn-trace-ctx
git_commit_date 1739895801 1739897266
git_commit_sha 0ba7b76f47 0f304c70e2
release_version 1.47.0-SNAPSHOT~0ba7b76f47 1.47.0-SNAPSHOT~0f304c70e2
start_time 2025-02-18T16:58:20 2025-02-18T17:05:25
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739898701 1739898701
ci_job_id 812393943 812393943
ci_pipeline_id 56180929 56180929
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-tsbfvevz-project-304-concurrent-0-fyx1n6o0 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-tsbfvevz-project-304-concurrent-0-fyx1n6o0 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 11 metrics, 16 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+34.983µs; +89.086µs] or [+2.286%; +5.821%]
unstable
[-574.972op/s; +574.972op/s] or [-19.405%; +19.405%]
1.592ms 2962.963op/s 1.530ms 2962.963op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~0f304c70e2, baseline=1.47.0-SNAPSHOT~0ba7b76f47
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.684 µs) : 359, 399
.   : milestone, 379,
iast (518.91 µs) : 497, 541
.   : milestone, 519,
iast_FULL (727.718 µs) : 706, 750
.   : milestone, 728,
iast_GLOBAL (560.072 µs) : 538, 582
.   : milestone, 560,
iast_HARDCODED_SECRET_DISABLED (513.96 µs) : 491, 537
.   : milestone, 514,
iast_INACTIVE (460.46 µs) : 439, 482
.   : milestone, 460,
iast_TELEMETRY_OFF (501.622 µs) : 478, 525
.   : milestone, 502,
tracing (456.374 µs) : 436, 477
.   : milestone, 456,
section candidate
no_agent (377.078 µs) : 357, 397
.   : milestone, 377,
iast (517.392 µs) : 495, 540
.   : milestone, 517,
iast_FULL (730.088 µs) : 708, 752
.   : milestone, 730,
iast_GLOBAL (571.721 µs) : 548, 596
.   : milestone, 572,
iast_HARDCODED_SECRET_DISABLED (514.872 µs) : 492, 537
.   : milestone, 515,
iast_INACTIVE (464.346 µs) : 443, 486
.   : milestone, 464,
iast_TELEMETRY_OFF (500.604 µs) : 479, 522
.   : milestone, 501,
tracing (461.627 µs) : 440, 483
.   : milestone, 462,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.684 µs [358.75 µs, 398.619 µs] -
iast 518.91 µs [496.744 µs, 541.075 µs] 140.225 µs (37.0%)
iast_FULL 727.718 µs [705.515 µs, 749.922 µs] 349.034 µs (92.2%)
iast_GLOBAL 560.072 µs [538.193 µs, 581.952 µs] 181.388 µs (47.9%)
iast_HARDCODED_SECRET_DISABLED 513.96 µs [490.918 µs, 537.002 µs] 135.275 µs (35.7%)
iast_INACTIVE 460.46 µs [438.626 µs, 482.294 µs] 81.775 µs (21.6%)
iast_TELEMETRY_OFF 501.622 µs [478.287 µs, 524.957 µs] 122.938 µs (32.5%)
tracing 456.374 µs [435.711 µs, 477.037 µs] 77.689 µs (20.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.078 µs [357.255 µs, 396.9 µs] -
iast 517.392 µs [494.684 µs, 540.099 µs] 140.314 µs (37.2%)
iast_FULL 730.088 µs [708.053 µs, 752.123 µs] 353.011 µs (93.6%)
iast_GLOBAL 571.721 µs [547.731 µs, 595.711 µs] 194.643 µs (51.6%)
iast_HARDCODED_SECRET_DISABLED 514.872 µs [492.443 µs, 537.3 µs] 137.794 µs (36.5%)
iast_INACTIVE 464.346 µs [442.828 µs, 485.863 µs] 87.268 µs (23.1%)
iast_TELEMETRY_OFF 500.604 µs [478.831 µs, 522.378 µs] 123.527 µs (32.8%)
tracing 461.627 µs [440.312 µs, 482.942 µs] 84.549 µs (22.4%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~0f304c70e2, baseline=1.47.0-SNAPSHOT~0ba7b76f47
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.364 ms) : 1345, 1384
.   : milestone, 1364,
appsec (1.737 ms) : 1713, 1761
.   : milestone, 1737,
appsec_no_iast (1.767 ms) : 1744, 1790
.   : milestone, 1767,
iast (1.516 ms) : 1492, 1540
.   : milestone, 1516,
profiling (1.53 ms) : 1505, 1555
.   : milestone, 1530,
tracing (1.499 ms) : 1475, 1524
.   : milestone, 1499,
section candidate
no_agent (1.358 ms) : 1339, 1377
.   : milestone, 1358,
appsec (1.768 ms) : 1744, 1792
.   : milestone, 1768,
appsec_no_iast (1.776 ms) : 1753, 1799
.   : milestone, 1776,
iast (1.526 ms) : 1502, 1550
.   : milestone, 1526,
profiling (1.592 ms) : 1567, 1618
.   : milestone, 1592,
tracing (1.487 ms) : 1462, 1512
.   : milestone, 1487,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.364 ms [1.345 ms, 1.384 ms] -
appsec 1.737 ms [1.713 ms, 1.761 ms] 372.673 µs (27.3%)
appsec_no_iast 1.767 ms [1.744 ms, 1.79 ms] 402.511 µs (29.5%)
iast 1.516 ms [1.492 ms, 1.54 ms] 151.887 µs (11.1%)
profiling 1.53 ms [1.505 ms, 1.555 ms] 166.0 µs (12.2%)
tracing 1.499 ms [1.475 ms, 1.524 ms] 135.073 µs (9.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.358 ms [1.339 ms, 1.377 ms] -
appsec 1.768 ms [1.744 ms, 1.792 ms] 410.283 µs (30.2%)
appsec_no_iast 1.776 ms [1.753 ms, 1.799 ms] 418.22 µs (30.8%)
iast 1.526 ms [1.502 ms, 1.55 ms] 168.543 µs (12.4%)
profiling 1.592 ms [1.567 ms, 1.618 ms] 234.488 µs (17.3%)
tracing 1.487 ms [1.462 ms, 1.512 ms] 128.995 µs (9.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master dylan/sfn-trace-ctx
git_commit_date 1739895801 1739897266
git_commit_sha 0ba7b76f47 0f304c70e2
release_version 1.47.0-SNAPSHOT~0ba7b76f47 1.47.0-SNAPSHOT~0f304c70e2
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1739899330 1739899330
ci_job_id 812393945 812393945
ci_pipeline_id 56180929 56180929
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-wxk4-4f-project-304-concurrent-1-388lq479 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-wxk4-4f-project-304-concurrent-1-388lq479 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~0f304c70e2, baseline=1.47.0-SNAPSHOT~0ba7b76f47
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.381 ms) : 2337, 2424
.   : milestone, 2381,
iast (2.127 ms) : 2072, 2183
.   : milestone, 2127,
iast_GLOBAL (2.166 ms) : 2110, 2221
.   : milestone, 2166,
profiling (1.969 ms) : 1925, 2013
.   : milestone, 1969,
tracing (1.955 ms) : 1913, 1997
.   : milestone, 1955,
section candidate
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (2.369 ms) : 2325, 2412
.   : milestone, 2369,
iast (2.129 ms) : 2074, 2184
.   : milestone, 2129,
iast_GLOBAL (2.159 ms) : 2103, 2214
.   : milestone, 2159,
profiling (1.963 ms) : 1920, 2006
.   : milestone, 1963,
tracing (1.961 ms) : 1919, 2004
.   : milestone, 1961,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.381 ms [2.337 ms, 2.424 ms] 904.526 µs (61.3%)
iast 2.127 ms [2.072 ms, 2.183 ms] 650.913 µs (44.1%)
iast_GLOBAL 2.166 ms [2.11 ms, 2.221 ms] 689.144 µs (46.7%)
profiling 1.969 ms [1.925 ms, 2.013 ms] 492.654 µs (33.4%)
tracing 1.955 ms [1.913 ms, 1.997 ms] 478.332 µs (32.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 2.369 ms [2.325 ms, 2.412 ms] 893.557 µs (60.6%)
iast 2.129 ms [2.074 ms, 2.184 ms] 654.197 µs (44.3%)
iast_GLOBAL 2.159 ms [2.103 ms, 2.214 ms] 683.734 µs (46.3%)
profiling 1.963 ms [1.92 ms, 2.006 ms] 487.8 µs (33.1%)
tracing 1.961 ms [1.919 ms, 2.004 ms] 486.152 µs (33.0%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~0f304c70e2, baseline=1.47.0-SNAPSHOT~0ba7b76f47
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.792 s) : 14792000, 14792000
.   : milestone, 14792000,
appsec (15.016 s) : 15016000, 15016000
.   : milestone, 15016000,
iast (18.913 s) : 18913000, 18913000
.   : milestone, 18913000,
iast_GLOBAL (17.864 s) : 17864000, 17864000
.   : milestone, 17864000,
profiling (15.125 s) : 15125000, 15125000
.   : milestone, 15125000,
tracing (14.984 s) : 14984000, 14984000
.   : milestone, 14984000,
section candidate
no_agent (15.457 s) : 15457000, 15457000
.   : milestone, 15457000,
appsec (14.983 s) : 14983000, 14983000
.   : milestone, 14983000,
iast (18.338 s) : 18338000, 18338000
.   : milestone, 18338000,
iast_GLOBAL (18.018 s) : 18018000, 18018000
.   : milestone, 18018000,
profiling (15.247 s) : 15247000, 15247000
.   : milestone, 15247000,
tracing (14.944 s) : 14944000, 14944000
.   : milestone, 14944000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.792 s [14.792 s, 14.792 s] -
appsec 15.016 s [15.016 s, 15.016 s] 224.0 ms (1.5%)
iast 18.913 s [18.913 s, 18.913 s] 4.121 s (27.9%)
iast_GLOBAL 17.864 s [17.864 s, 17.864 s] 3.072 s (20.8%)
profiling 15.125 s [15.125 s, 15.125 s] 333.0 ms (2.3%)
tracing 14.984 s [14.984 s, 14.984 s] 192.0 ms (1.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.457 s [15.457 s, 15.457 s] -
appsec 14.983 s [14.983 s, 14.983 s] -474.0 ms (-3.1%)
iast 18.338 s [18.338 s, 18.338 s] 2.881 s (18.6%)
iast_GLOBAL 18.018 s [18.018 s, 18.018 s] 2.561 s (16.6%)
profiling 15.247 s [15.247 s, 15.247 s] -210.0 ms (-1.4%)
tracing 14.944 s [14.944 s, 14.944 s] -513.0 ms (-3.3%)

pr-commenter[bot] avatar Sep 16 '24 18:09 pr-commenter[bot]

@PerfectSlayer I think I covered all of the comments/corrections, but for some reason the CI's muzzle check is continuing to fail :/ It seems like it's mostly timing out, so may be unrelated to my changes?

DylanLovesCoffee avatar Oct 21 '24 14:10 DylanLovesCoffee

I'm working on #7973 that might help with the JSON part.

PerfectSlayer avatar Nov 21 '24 10:11 PerfectSlayer

@nhulston is this PR ready to be reviewed ? I see that it does not build. Otherwise it can be put in draft for now

amarziali avatar Dec 06 '24 13:12 amarziali

Failures appear to be unrelated

nhulston avatar Feb 07 '25 16:02 nhulston