dd-trace-java icon indicating copy to clipboard operation
dd-trace-java copied to clipboard

Initial dsm extractors configuration

Open kr-igor opened this issue 4 months ago • 4 comments

What Does This Do

Initial transaction tracking implementation targeting http and kafka traffic.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

kr-igor avatar Nov 03 '25 20:11 kr-igor

🎯 Code Coverage
Patch Coverage: 57.30%
Total Coverage: 55.64% (-3.98%)
View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 7ea2ba5 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-transaction-extractors
git_commit_date 1762980363 1763577171
git_commit_sha ff3c612ad9 413efac28e
release_version 1.56.0-SNAPSHOT~ff3c612ad9 1.56.0-SNAPSHOT~413efac28e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763579262 1763579262
ci_job_id 1245772741 1245772741
ci_pipeline_id 83229308 83229308
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-pd9lg8iu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-pd9lg8iu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.109 s) : 0, 1109062
Total [baseline] (10.801 s) : 0, 10800812
Agent [candidate] (1.115 s) : 0, 1115168
Total [candidate] (10.865 s) : 0, 10865474
section appsec
Agent [baseline] (1.292 s) : 0, 1292347
Total [baseline] (11.156 s) : 0, 11156334
Agent [candidate] (1.282 s) : 0, 1282078
Total [candidate] (11.17 s) : 0, 11169632
section iast
Agent [baseline] (1.243 s) : 0, 1242703
Total [baseline] (11.335 s) : 0, 11334819
Agent [candidate] (1.248 s) : 0, 1247593
Total [candidate] (11.21 s) : 0, 11209612
section profiling
Agent [baseline] (1.235 s) : 0, 1234865
Total [baseline] (11.11 s) : 0, 11110479
Agent [candidate] (1.245 s) : 0, 1244555
Total [candidate] (11.12 s) : 0, 11120395
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.109 s -
Agent appsec 1.292 s 183.285 ms (16.5%)
Agent iast 1.243 s 133.641 ms (12.0%)
Agent profiling 1.235 s 125.803 ms (11.3%)
Total tracing 10.801 s -
Total appsec 11.156 s 355.522 ms (3.3%)
Total iast 11.335 s 534.007 ms (4.9%)
Total profiling 11.11 s 309.667 ms (2.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.115 s -
Agent appsec 1.282 s 166.91 ms (15.0%)
Agent iast 1.248 s 132.425 ms (11.9%)
Agent profiling 1.245 s 129.387 ms (11.6%)
Total tracing 10.865 s -
Total appsec 11.17 s 304.157 ms (2.8%)
Total iast 11.21 s 344.138 ms (3.2%)
Total profiling 11.12 s 254.921 ms (2.3%)
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (708.079 ms) : 0, 708079
BytebuddyAgent [candidate] (710.764 ms) : 0, 710764
GlobalTracer [baseline] (249.992 ms) : 0, 249992
GlobalTracer [candidate] (253.522 ms) : 0, 253522
AppSec [baseline] (32.698 ms) : 0, 32698
AppSec [candidate] (32.999 ms) : 0, 32999
Debugger [baseline] (69.8 ms) : 0, 69800
Debugger [candidate] (68.98 ms) : 0, 68980
Remote Config [baseline] (636.67 µs) : 0, 637
Remote Config [candidate] (639.869 µs) : 0, 640
Telemetry [baseline] (8.11 ms) : 0, 8110
Telemetry [candidate] (8.24 ms) : 0, 8240
Flare Poller [baseline] (3.664 ms) : 0, 3664
Flare Poller [candidate] (3.874 ms) : 0, 3874
section appsec
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (737.101 ms) : 0, 737101
BytebuddyAgent [candidate] (728.674 ms) : 0, 728674
GlobalTracer [baseline] (243.979 ms) : 0, 243979
GlobalTracer [candidate] (243.771 ms) : 0, 243771
IAST [baseline] (25.118 ms) : 0, 25118
IAST [candidate] (24.723 ms) : 0, 24723
AppSec [baseline] (175.147 ms) : 0, 175147
AppSec [candidate] (174.172 ms) : 0, 174172
Debugger [baseline] (61.701 ms) : 0, 61701
Debugger [candidate] (61.5 ms) : 0, 61500
Remote Config [baseline] (667.033 µs) : 0, 667
Remote Config [candidate] (725.987 µs) : 0, 726
Telemetry [baseline] (8.32 ms) : 0, 8320
Telemetry [candidate] (8.303 ms) : 0, 8303
Flare Poller [baseline] (3.825 ms) : 0, 3825
Flare Poller [candidate] (3.987 ms) : 0, 3987
section iast
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (829.61 ms) : 0, 829610
BytebuddyAgent [candidate] (830.199 ms) : 0, 830199
GlobalTracer [baseline] (237.948 ms) : 0, 237948
GlobalTracer [candidate] (241.556 ms) : 0, 241556
IAST [baseline] (26.516 ms) : 0, 26516
IAST [candidate] (26.787 ms) : 0, 26787
AppSec [baseline] (35.114 ms) : 0, 35114
AppSec [candidate] (35.31 ms) : 0, 35310
Debugger [baseline] (65.569 ms) : 0, 65569
Debugger [candidate] (65.703 ms) : 0, 65703
Remote Config [baseline] (541.399 µs) : 0, 541
Remote Config [candidate] (572.503 µs) : 0, 573
Telemetry [baseline] (7.663 ms) : 0, 7663
Telemetry [candidate] (7.627 ms) : 0, 7627
Flare Poller [baseline] (3.566 ms) : 0, 3566
Flare Poller [candidate] (3.614 ms) : 0, 3614
section profiling
crashtracking [baseline] (1.435 ms) : 0, 1435
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (730.409 ms) : 0, 730409
BytebuddyAgent [candidate] (734.645 ms) : 0, 734645
GlobalTracer [baseline] (222.151 ms) : 0, 222151
GlobalTracer [candidate] (226.549 ms) : 0, 226549
AppSec [baseline] (32.253 ms) : 0, 32253
AppSec [candidate] (32.751 ms) : 0, 32751
Debugger [baseline] (68.689 ms) : 0, 68689
Debugger [candidate] (68.663 ms) : 0, 68663
Remote Config [baseline] (654.26 µs) : 0, 654
Remote Config [candidate] (667.615 µs) : 0, 668
Telemetry [baseline] (8.103 ms) : 0, 8103
Telemetry [candidate] (8.02 ms) : 0, 8020
Flare Poller [baseline] (3.787 ms) : 0, 3787
Flare Poller [candidate] (3.943 ms) : 0, 3943
ProfilingAgent [baseline] (97.681 ms) : 0, 97681
ProfilingAgent [candidate] (97.765 ms) : 0, 97765
Profiling [baseline] (98.283 ms) : 0, 98283
Profiling [candidate] (98.346 ms) : 0, 98346
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.103 s) : 0, 1102870
Total [baseline] (8.87 s) : 0, 8869842
Agent [candidate] (1.106 s) : 0, 1105609
Total [candidate] (8.895 s) : 0, 8895117
section iast
Agent [baseline] (1.26 s) : 0, 1260282
Total [baseline] (9.582 s) : 0, 9581538
Agent [candidate] (1.242 s) : 0, 1241700
Total [candidate] (9.55 s) : 0, 9549603
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.103 s -
Agent iast 1.26 s 157.412 ms (14.3%)
Total tracing 8.87 s -
Total iast 9.582 s 711.695 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.106 s -
Agent iast 1.242 s 136.091 ms (12.3%)
Total tracing 8.895 s -
Total iast 9.55 s 654.486 ms (7.4%)
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (705.293 ms) : 0, 705293
BytebuddyAgent [candidate] (705.236 ms) : 0, 705236
GlobalTracer [baseline] (248.342 ms) : 0, 248342
GlobalTracer [candidate] (252.004 ms) : 0, 252004
AppSec [baseline] (32.229 ms) : 0, 32229
AppSec [candidate] (32.763 ms) : 0, 32763
Debugger [baseline] (68.364 ms) : 0, 68364
Debugger [candidate] (66.856 ms) : 0, 66856
Remote Config [baseline] (627.169 µs) : 0, 627
Remote Config [candidate] (635.708 µs) : 0, 636
Telemetry [baseline] (8.149 ms) : 0, 8149
Telemetry [candidate] (8.221 ms) : 0, 8221
Flare Poller [baseline] (3.712 ms) : 0, 3712
Flare Poller [candidate] (3.781 ms) : 0, 3781
section iast
crashtracking [baseline] (1.493 ms) : 0, 1493
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (844.248 ms) : 0, 844248
BytebuddyAgent [candidate] (827.092 ms) : 0, 827092
GlobalTracer [baseline] (239.986 ms) : 0, 239986
GlobalTracer [candidate] (240.738 ms) : 0, 240738
IAST [baseline] (27.06 ms) : 0, 27060
IAST [candidate] (28.411 ms) : 0, 28411
AppSec [baseline] (35.413 ms) : 0, 35413
AppSec [candidate] (33.229 ms) : 0, 33229
Debugger [baseline] (65.252 ms) : 0, 65252
Debugger [candidate] (64.433 ms) : 0, 64433
Remote Config [baseline] (548.595 µs) : 0, 549
Remote Config [candidate] (536.789 µs) : 0, 537
Telemetry [baseline] (7.676 ms) : 0, 7676
Telemetry [candidate] (7.652 ms) : 0, 7652
Flare Poller [baseline] (3.529 ms) : 0, 3529
Flare Poller [candidate] (3.581 ms) : 0, 3581

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-transaction-extractors
git_commit_date 1762980363 1763577171
git_commit_sha ff3c612ad9 413efac28e
release_version 1.56.0-SNAPSHOT~ff3c612ad9 1.56.0-SNAPSHOT~413efac28e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763579752 1763579752
ci_job_id 1245772743 1245772743
ci_pipeline_id 83229308 83229308
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-wrkeimx1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-wrkeimx1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+218.542µs; +322.282µs] or [+7.626%; +11.246%]
worse
[+264.845µs; +655.656µs] or [+3.321%; +8.222%]
unstable
[-199.062op/s; +63.874op/s] or [-15.956%; +5.120%]
3.136ms 8.435ms 1179.938op/s 2.866ms 7.974ms 1247.531op/s
scenario:load:insecure-bank:iast:high_load worse
[+60.870µs; +159.266µs] or [+2.581%; +6.754%]
unstable
[-328.873µs; +399.438µs] or [-4.582%; +5.565%]
unstable
[-195.275op/s; +94.588op/s] or [-13.138%; +6.364%]
2.468ms 7.213ms 1435.969op/s 2.358ms 7.178ms 1486.312op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.197 ms) : 1185, 1208
.   : milestone, 1197,
iast (3.075 ms) : 3035, 3115
.   : milestone, 3075,
iast_FULL (5.758 ms) : 5701, 5815
.   : milestone, 5758,
iast_GLOBAL (3.678 ms) : 3547, 3808
.   : milestone, 3678,
profiling (2.203 ms) : 2183, 2223
.   : milestone, 2203,
tracing (1.889 ms) : 1871, 1908
.   : milestone, 1889,
section candidate
no_agent (1.19 ms) : 1178, 1202
.   : milestone, 1190,
iast (3.185 ms) : 3143, 3228
.   : milestone, 3185,
iast_FULL (5.791 ms) : 5734, 5849
.   : milestone, 5791,
iast_GLOBAL (3.897 ms) : 3836, 3957
.   : milestone, 3897,
profiling (2.076 ms) : 2057, 2094
.   : milestone, 2076,
tracing (1.824 ms) : 1810, 1839
.   : milestone, 1824,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.197 ms [1.185 ms, 1.208 ms] -
iast 3.075 ms [3.035 ms, 3.115 ms] 1.879 ms (157.0%)
iast_FULL 5.758 ms [5.701 ms, 5.815 ms] 4.562 ms (381.3%)
iast_GLOBAL 3.678 ms [3.547 ms, 3.808 ms] 2.481 ms (207.4%)
profiling 2.203 ms [2.183 ms, 2.223 ms] 1.006 ms (84.1%)
tracing 1.889 ms [1.871 ms, 1.908 ms] 692.961 µs (57.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.19 ms [1.178 ms, 1.202 ms] -
iast 3.185 ms [3.143 ms, 3.228 ms] 1.995 ms (167.7%)
iast_FULL 5.791 ms [5.734 ms, 5.849 ms] 4.601 ms (386.7%)
iast_GLOBAL 3.897 ms [3.836 ms, 3.957 ms] 2.707 ms (227.4%)
profiling 2.076 ms [2.057 ms, 2.094 ms] 885.621 µs (74.4%)
tracing 1.824 ms [1.81 ms, 1.839 ms] 634.267 µs (53.3%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.88 ms) : 17698, 18062
.   : milestone, 17880,
appsec (18.619 ms) : 18429, 18809
.   : milestone, 18619,
code_origins (17.772 ms) : 17601, 17944
.   : milestone, 17772,
iast (17.68 ms) : 17503, 17857
.   : milestone, 17680,
profiling (19.576 ms) : 19377, 19774
.   : milestone, 19576,
tracing (17.308 ms) : 17137, 17479
.   : milestone, 17308,
section candidate
no_agent (17.04 ms) : 16870, 17209
.   : milestone, 17040,
appsec (19.258 ms) : 19063, 19453
.   : milestone, 19258,
code_origins (17.835 ms) : 17655, 18015
.   : milestone, 17835,
iast (17.79 ms) : 17609, 17971
.   : milestone, 17790,
profiling (19.87 ms) : 19672, 20069
.   : milestone, 19870,
tracing (17.566 ms) : 17391, 17741
.   : milestone, 17566,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.88 ms [17.698 ms, 18.062 ms] -
appsec 18.619 ms [18.429 ms, 18.809 ms] 738.878 µs (4.1%)
code_origins 17.772 ms [17.601 ms, 17.944 ms] -107.814 µs (-0.6%)
iast 17.68 ms [17.503 ms, 17.857 ms] -199.928 µs (-1.1%)
profiling 19.576 ms [19.377 ms, 19.774 ms] 1.696 ms (9.5%)
tracing 17.308 ms [17.137 ms, 17.479 ms] -571.923 µs (-3.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.04 ms [16.87 ms, 17.209 ms] -
appsec 19.258 ms [19.063 ms, 19.453 ms] 2.218 ms (13.0%)
code_origins 17.835 ms [17.655 ms, 18.015 ms] 795.343 µs (4.7%)
iast 17.79 ms [17.609 ms, 17.971 ms] 750.474 µs (4.4%)
profiling 19.87 ms [19.672 ms, 20.069 ms] 2.831 ms (16.6%)
tracing 17.566 ms [17.391 ms, 17.741 ms] 526.245 µs (3.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-transaction-extractors
git_commit_date 1762980363 1763577171
git_commit_sha ff3c612ad9 413efac28e
release_version 1.56.0-SNAPSHOT~ff3c612ad9 1.56.0-SNAPSHOT~413efac28e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763579349 1763579349
ci_job_id 1245772746 1245772746
ci_pipeline_id 83229308 83229308
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-76lbzd9v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-76lbzd9v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.489 ms) : 1477, 1500
.   : milestone, 1489,
appsec (3.701 ms) : 3483, 3919
.   : milestone, 3701,
iast (2.228 ms) : 2164, 2292
.   : milestone, 2228,
iast_GLOBAL (2.268 ms) : 2204, 2332
.   : milestone, 2268,
profiling (2.093 ms) : 2040, 2146
.   : milestone, 2093,
tracing (2.047 ms) : 1997, 2097
.   : milestone, 2047,
section candidate
no_agent (1.483 ms) : 1471, 1494
.   : milestone, 1483,
appsec (3.729 ms) : 3509, 3949
.   : milestone, 3729,
iast (2.22 ms) : 2156, 2284
.   : milestone, 2220,
iast_GLOBAL (2.267 ms) : 2202, 2331
.   : milestone, 2267,
profiling (2.485 ms) : 2276, 2695
.   : milestone, 2485,
tracing (2.053 ms) : 2003, 2103
.   : milestone, 2053,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.489 ms [1.477 ms, 1.5 ms] -
appsec 3.701 ms [3.483 ms, 3.919 ms] 2.213 ms (148.6%)
iast 2.228 ms [2.164 ms, 2.292 ms] 739.257 µs (49.7%)
iast_GLOBAL 2.268 ms [2.204 ms, 2.332 ms] 779.542 µs (52.4%)
profiling 2.093 ms [2.04 ms, 2.146 ms] 604.246 µs (40.6%)
tracing 2.047 ms [1.997 ms, 2.097 ms] 558.575 µs (37.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.494 ms] -
appsec 3.729 ms [3.509 ms, 3.949 ms] 2.246 ms (151.5%)
iast 2.22 ms [2.156 ms, 2.284 ms] 737.536 µs (49.7%)
iast_GLOBAL 2.267 ms [2.202 ms, 2.331 ms] 784.214 µs (52.9%)
profiling 2.485 ms [2.276 ms, 2.695 ms] 1.003 ms (67.6%)
tracing 2.053 ms [2.003 ms, 2.103 ms] 570.364 µs (38.5%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~413efac28e, baseline=1.56.0-SNAPSHOT~ff3c612ad9
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.97 s) : 14970000, 14970000
.   : milestone, 14970000,
appsec (15.004 s) : 15004000, 15004000
.   : milestone, 15004000,
iast (18.71 s) : 18710000, 18710000
.   : milestone, 18710000,
iast_GLOBAL (18.082 s) : 18082000, 18082000
.   : milestone, 18082000,
profiling (15.234 s) : 15234000, 15234000
.   : milestone, 15234000,
tracing (14.922 s) : 14922000, 14922000
.   : milestone, 14922000,
section candidate
no_agent (14.926 s) : 14926000, 14926000
.   : milestone, 14926000,
appsec (14.799 s) : 14799000, 14799000
.   : milestone, 14799000,
iast (18.611 s) : 18611000, 18611000
.   : milestone, 18611000,
iast_GLOBAL (17.786 s) : 17786000, 17786000
.   : milestone, 17786000,
profiling (15.142 s) : 15142000, 15142000
.   : milestone, 15142000,
tracing (14.826 s) : 14826000, 14826000
.   : milestone, 14826000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.97 s [14.97 s, 14.97 s] -
appsec 15.004 s [15.004 s, 15.004 s] 34.0 ms (0.2%)
iast 18.71 s [18.71 s, 18.71 s] 3.74 s (25.0%)
iast_GLOBAL 18.082 s [18.082 s, 18.082 s] 3.112 s (20.8%)
profiling 15.234 s [15.234 s, 15.234 s] 264.0 ms (1.8%)
tracing 14.922 s [14.922 s, 14.922 s] -48.0 ms (-0.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.926 s [14.926 s, 14.926 s] -
appsec 14.799 s [14.799 s, 14.799 s] -127.0 ms (-0.9%)
iast 18.611 s [18.611 s, 18.611 s] 3.685 s (24.7%)
iast_GLOBAL 17.786 s [17.786 s, 17.786 s] 2.86 s (19.2%)
profiling 15.142 s [15.142 s, 15.142 s] 216.0 ms (1.4%)
tracing 14.826 s [14.826 s, 14.826 s] -100.0 ms (-0.7%)

pr-commenter[bot] avatar Nov 03 '25 21:11 pr-commenter[bot]

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-transaction-extractors
git_commit_date 1762980363 1763577171
git_commit_sha ff3c612ad920f48b0093b8380520fea8ba13e96b 413efac28e6c5f7c2ebfed477d4e6981377577d3
See matching parameters
Baseline Candidate
ci_job_date 1763578466 1763578466
ci_job_id 1245772751 1245772751
ci_pipeline_id 83229308 83229308
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

pr-commenter[bot] avatar Nov 10 '25 22:11 pr-commenter[bot]

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-transaction-extractors
git_commit_date 1762980363 1763577171
git_commit_sha ff3c612ad920f48b0093b8380520fea8ba13e96b 413efac28e6c5f7c2ebfed477d4e6981377577d3
See matching parameters
Baseline Candidate
ci_job_date 1763578498 1763578498
ci_job_id 1245772752 1245772752
ci_pipeline_id 83229308 83229308
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[+901.344op/s; +4415.732op/s] or [+0.539%; +2.639%]

pr-commenter[bot] avatar Nov 12 '25 18:11 pr-commenter[bot]