What Does This Do

The openai-java v3.0+ instrumentation for completions, chat completions, embeddings, and responses.

Passes all APM test:

test_openai.py::TestOpenAiApm::test_chat_completion[java-test-ml-app-tcp-True] PASSED [ 12%]
test_openai.py::TestOpenAiApm::test_chat_completion[java-test-ml-app-tcp-False] PASSED [ 25%]
test_openai.py::TestOpenAiApm::test_completion[java-test-ml-app-tcp] PASSED [ 37%]
test_openai.py::TestOpenAiApm::test_embedding[java-test-ml-app-tcp] PASSED [ 50%]
test_openai.py::TestOpenAiApm::test_chat_completion_tool_call[java-test-ml-app-tcp-True] PASSED [ 62%]
test_openai.py::TestOpenAiApm::test_chat_completion_tool_call[java-test-ml-app-tcp-False] PASSED [ 75%]
test_openai.py::TestOpenAiApm::test_responses_create[java-test-ml-app-tcp-True] PASSED [ 87%]
test_openai.py::TestOpenAiApm::test_responses_create[java-test-ml-app-tcp-False] PASSED [100%]

LLMObs test WIP 12/15:

test_openai.py::TestOpenAiLlmObs::test_chat_completion[java-test-ml-app-tcp-True] PASSED [  6%]
test_openai.py::TestOpenAiLlmObs::test_chat_completion[java-test-ml-app-tcp-False] PASSED [ 13%]
test_openai.py::TestOpenAiLlmObs::test_completion[java-test-ml-app-tcp] PASSED [ 20%]
test_openai.py::TestOpenAiLlmObs::test_embedding[java-test-ml-app-tcp] PASSED [ 26%]
test_openai.py::TestOpenAiLlmObs::test_chat_completion_tool_call[java-test-ml-app-tcp-True] PASSED [ 33%]
test_openai.py::TestOpenAiLlmObs::test_chat_completion_tool_call[java-test-ml-app-tcp-False] PASSED [ 40%]

test_openai.py::TestOpenAiLlmObs::test_chat_completion_telemetry[java-test-ml-app-tcp] SKIPPED [ 46%]

test_openai.py::TestOpenAiLlmObs::test_responses_create[java-test-ml-app-tcp-True] PASSED [ 53%]
test_openai.py::TestOpenAiLlmObs::test_responses_create[java-test-ml-app-tcp-False] PASSED [ 60%]
test_openai.py::TestOpenAiLlmObs::test_responses_create_tool_call[java-test-ml-app-tcp-True] PASSED [ 66%]
test_openai.py::TestOpenAiLlmObs::test_responses_create_tool_call[java-test-ml-app-tcp-False] PASSED [ 73%]
test_openai.py::TestOpenAiLlmObs::test_responses_create_reasoning[java-test-ml-app-tcp-True] PASSED [ 80%]
test_openai.py::TestOpenAiLlmObs::test_responses_create_reasoning[java-test-ml-app-tcp-False] PASSED [ 86%]

test_openai.py::TestOpenAiLlmObs::test_responses_create_tool_input[java-test-ml-app-tcp-True] SKIPPED [ 93%]
test_openai.py::TestOpenAiLlmObs::test_responses_create_tool_input[java-test-ml-app-tcp-False] SKIPPED [100%]

TBD: telemetry

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

Nov 13 '25 20:11 ygree

🎯 Code Coverage
• Patch Coverage: 21.62%
• Total Coverage: 59.62% (-0.04%)
View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: f2d4428 | Docs | Datadog PR Page | Was this helpful? Give us feedback!}

Nov 13 '25 20:11 datadog-datadog-prod-us1[bot]

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ygree/openai-java
git_commit_date	1766503833	1766521744
git_commit_sha	ab049bd23d	ff22fa8767
release_version	1.58.0-SNAPSHOT~ab049bd23d	1.55.0-SNAPSHOT~ff22fa8767

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1766523482	1766523482
ci_job_id	1316662171	1316662171
ci_pipeline_id	88228826	88228826
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-1aedp8i4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-1aedp8i4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 54 metrics, 8 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:tracing:Flare Poller	worse [+89.323µs; +341.696µs] or [+2.390%; +9.143%]	3.953ms	3.737ms
scenario:startup:petclinic:profiling:ProfilingAgent	better [-6.272ms; -2.515ms] or [-6.481%; -2.598%]	92.394ms	96.788ms
scenario:startup:petclinic:profiling:Profiling	better [-6.282ms; -2.484ms] or [-6.451%; -2.551%]	92.992ms	97.375ms

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~ff22fa8767, baseline=1.58.0-SNAPSHOT~ab049bd23d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.1 s) : 0, 1099818
Total [baseline] (10.973 s) : 0, 10973002
Agent [candidate] (1.097 s) : 0, 1096935
Total [candidate] (10.711 s) : 0, 10710724
section appsec
Agent [baseline] (1.266 s) : 0, 1266229
Total [baseline] (10.922 s) : 0, 10922454
Agent [candidate] (1.275 s) : 0, 1274593
Total [candidate] (10.827 s) : 0, 10826524
section iast
Agent [baseline] (1.233 s) : 0, 1232931
Total [baseline] (11.208 s) : 0, 11208261
Agent [candidate] (1.231 s) : 0, 1230587
Total [candidate] (11.025 s) : 0, 11024831
section profiling
Agent [baseline] (1.206 s) : 0, 1206390
Total [baseline] (10.882 s) : 0, 10881901
Agent [candidate] (1.208 s) : 0, 1207762
Total [candidate] (10.982 s) : 0, 10981805

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.1 s	-
Agent	appsec	1.266 s	166.412 ms (15.1%)
Agent	iast	1.233 s	133.113 ms (12.1%)
Agent	profiling	1.206 s	106.572 ms (9.7%)
Total	tracing	10.973 s	-
Total	appsec	10.922 s	-50.548 ms (-0.5%)
Total	iast	11.208 s	235.259 ms (2.1%)
Total	profiling	10.882 s	-91.101 ms (-0.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.097 s	-
Agent	appsec	1.275 s	177.658 ms (16.2%)
Agent	iast	1.231 s	133.651 ms (12.2%)
Agent	profiling	1.208 s	110.826 ms (10.1%)
Total	tracing	10.711 s	-
Total	appsec	10.827 s	115.8 ms (1.1%)
Total	iast	11.025 s	314.107 ms (2.9%)
Total	profiling	10.982 s	271.08 ms (2.5%)

gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~ff22fa8767, baseline=1.58.0-SNAPSHOT~ab049bd23d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.205 ms) : 0, 1205
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (660.913 ms) : 0, 660913
BytebuddyAgent [candidate] (661.17 ms) : 0, 661170
GlobalTracer [baseline] (285.999 ms) : 0, 285999
GlobalTracer [candidate] (284.171 ms) : 0, 284171
AppSec [baseline] (33.355 ms) : 0, 33355
AppSec [candidate] (32.813 ms) : 0, 32813
Debugger [baseline] (69.048 ms) : 0, 69048
Debugger [candidate] (68.609 ms) : 0, 68609
Remote Config [baseline] (622.241 µs) : 0, 622
Remote Config [candidate] (607.59 µs) : 0, 608
Telemetry [baseline] (9.023 ms) : 0, 9023
Telemetry [candidate] (8.929 ms) : 0, 8929
Flare Poller [baseline] (3.837 ms) : 0, 3837
Flare Poller [candidate] (3.886 ms) : 0, 3886
section appsec
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (692.134 ms) : 0, 692134
BytebuddyAgent [candidate] (699.613 ms) : 0, 699613
GlobalTracer [baseline] (258.156 ms) : 0, 258156
GlobalTracer [candidate] (258.157 ms) : 0, 258157
IAST [baseline] (24.784 ms) : 0, 24784
IAST [candidate] (24.683 ms) : 0, 24683
AppSec [baseline] (174.374 ms) : 0, 174374
AppSec [candidate] (172.44 ms) : 0, 172440
Debugger [baseline] (66.199 ms) : 0, 66199
Debugger [candidate] (68.885 ms) : 0, 68885
Remote Config [baseline] (757.906 µs) : 0, 758
Remote Config [candidate] (779.746 µs) : 0, 780
Telemetry [baseline] (9.499 ms) : 0, 9499
Telemetry [candidate] (9.543 ms) : 0, 9543
Flare Poller [baseline] (3.688 ms) : 0, 3688
Flare Poller [candidate] (3.747 ms) : 0, 3747
section iast
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (798.349 ms) : 0, 798349
BytebuddyAgent [candidate] (799.619 ms) : 0, 799619
GlobalTracer [baseline] (256.889 ms) : 0, 256889
GlobalTracer [candidate] (254.149 ms) : 0, 254149
IAST [baseline] (27.599 ms) : 0, 27599
IAST [candidate] (27.021 ms) : 0, 27021
AppSec [baseline] (34.596 ms) : 0, 34596
AppSec [candidate] (35.325 ms) : 0, 35325
Debugger [baseline] (66.253 ms) : 0, 66253
Debugger [candidate] (64.987 ms) : 0, 64987
Remote Config [baseline] (614.968 µs) : 0, 615
Remote Config [candidate] (578.935 µs) : 0, 579
Telemetry [baseline] (8.508 ms) : 0, 8508
Telemetry [candidate] (8.708 ms) : 0, 8708
Flare Poller [baseline] (3.504 ms) : 0, 3504
Flare Poller [candidate] (3.573 ms) : 0, 3573
section profiling
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.227 ms) : 0, 1227
BytebuddyAgent [baseline] (704.443 ms) : 0, 704443
BytebuddyAgent [candidate] (705.454 ms) : 0, 705454
GlobalTracer [baseline] (220.794 ms) : 0, 220794
GlobalTracer [candidate] (219.466 ms) : 0, 219466
AppSec [baseline] (32.208 ms) : 0, 32208
AppSec [candidate] (32.385 ms) : 0, 32385
Debugger [baseline] (68.099 ms) : 0, 68099
Debugger [candidate] (68.385 ms) : 0, 68385
Remote Config [baseline] (640.457 µs) : 0, 640
Remote Config [candidate] (630.96 µs) : 0, 631
Telemetry [baseline] (8.716 ms) : 0, 8716
Telemetry [candidate] (8.901 ms) : 0, 8901
Flare Poller [baseline] (3.621 ms) : 0, 3621
Flare Poller [candidate] (9.26 ms) : 0, 9260
ProfilingAgent [baseline] (96.788 ms) : 0, 96788
ProfilingAgent [candidate] (92.394 ms) : 0, 92394
Profiling [baseline] (97.375 ms) : 0, 97375
Profiling [candidate] (92.992 ms) : 0, 92992

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~ff22fa8767, baseline=1.58.0-SNAPSHOT~ab049bd23d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.084 s) : 0, 1083957
Total [baseline] (8.729 s) : 0, 8729146
Agent [candidate] (1.09 s) : 0, 1090184
Total [candidate] (8.743 s) : 0, 8742773
section iast
Agent [baseline] (1.223 s) : 0, 1223307
Total [baseline] (9.311 s) : 0, 9310686
Agent [candidate] (1.235 s) : 0, 1235059
Total [candidate] (9.32 s) : 0, 9320090

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.084 s	-
Agent	iast	1.223 s	139.35 ms (12.9%)
Total	tracing	8.729 s	-
Total	iast	9.311 s	581.54 ms (6.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.09 s	-
Agent	iast	1.235 s	144.874 ms (13.3%)
Total	tracing	8.743 s	-
Total	iast	9.32 s	577.318 ms (6.6%)

gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~ff22fa8767, baseline=1.58.0-SNAPSHOT~ab049bd23d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (652.028 ms) : 0, 652028
BytebuddyAgent [candidate] (656.673 ms) : 0, 656673
GlobalTracer [baseline] (281.926 ms) : 0, 281926
GlobalTracer [candidate] (282.961 ms) : 0, 282961
AppSec [baseline] (32.629 ms) : 0, 32629
AppSec [candidate] (32.79 ms) : 0, 32790
Debugger [baseline] (67.434 ms) : 0, 67434
Debugger [candidate] (67.454 ms) : 0, 67454
Remote Config [baseline] (623.27 µs) : 0, 623
Remote Config [candidate] (628.266 µs) : 0, 628
Telemetry [baseline] (8.922 ms) : 0, 8922
Telemetry [candidate] (9.114 ms) : 0, 9114
Flare Poller [baseline] (3.737 ms) : 0, 3737
Flare Poller [candidate] (3.953 ms) : 0, 3953
section iast
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (792.521 ms) : 0, 792521
BytebuddyAgent [candidate] (802.842 ms) : 0, 802842
GlobalTracer [baseline] (255.046 ms) : 0, 255046
GlobalTracer [candidate] (255.865 ms) : 0, 255865
IAST [baseline] (26.931 ms) : 0, 26931
IAST [candidate] (27.328 ms) : 0, 27328
AppSec [baseline] (34.63 ms) : 0, 34630
AppSec [candidate] (35.407 ms) : 0, 35407
Debugger [baseline] (64.944 ms) : 0, 64944
Debugger [candidate] (64.149 ms) : 0, 64149
Remote Config [baseline] (592.349 µs) : 0, 592
Remote Config [candidate] (564.011 µs) : 0, 564
Telemetry [baseline] (8.477 ms) : 0, 8477
Telemetry [candidate] (8.744 ms) : 0, 8744
Flare Poller [baseline] (3.518 ms) : 0, 3518
Flare Poller [candidate] (3.505 ms) : 0, 3505

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ygree/openai-java
git_commit_date	1766503833	1766521744
git_commit_sha	ab049bd23d	ff22fa8767
release_version	1.58.0-SNAPSHOT~ab049bd23d	1.55.0-SNAPSHOT~ff22fa8767

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1766524075	1766524075
ci_job_id	1316662172	1316662172
ci_pipeline_id	88228826	88228826
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-s98vrkh9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-s98vrkh9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 19 metrics, 15 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:no_agent:high_load	worse [+403.739µs; +1531.094µs] or [+2.310%; +8.761%]	unsure [+0.232ms; +2.822ms] or [+0.795%; +9.671%]	unstable [-39.453op/s; +10.890op/s] or [-15.207%; +4.198%]	18.443ms	30.709ms	245.156op/s	17.476ms	29.182ms	259.438op/s
scenario:load:petclinic:appsec:high_load	worse [+436.433µs; +1450.988µs] or [+2.387%; +7.937%]	same [-40.108µs; +1546.438µs] or [-0.134%; +5.178%]	unstable [-34.645op/s; +12.520op/s] or [-13.782%; +4.981%]	19.225ms	30.620ms	240.312op/s	18.281ms	29.867ms	251.375op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~ff22fa8767, baseline=1.58.0-SNAPSHOT~ab049bd23d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.178 ms) : 1166, 1190
.   : milestone, 1178,
iast (3.23 ms) : 3192, 3268
.   : milestone, 3230,
iast_FULL (5.785 ms) : 5727, 5843
.   : milestone, 5785,
iast_GLOBAL (3.57 ms) : 3514, 3626
.   : milestone, 3570,
profiling (1.907 ms) : 1891, 1922
.   : milestone, 1907,
tracing (1.813 ms) : 1797, 1830
.   : milestone, 1813,
section candidate
no_agent (1.181 ms) : 1170, 1193
.   : milestone, 1181,
iast (3.135 ms) : 3098, 3172
.   : milestone, 3135,
iast_FULL (5.829 ms) : 5770, 5887
.   : milestone, 5829,
iast_GLOBAL (3.652 ms) : 3594, 3710
.   : milestone, 3652,
profiling (1.974 ms) : 1957, 1992
.   : milestone, 1974,
tracing (1.804 ms) : 1789, 1818
.   : milestone, 1804,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.178 ms [1.166 ms, 1.19 ms]	-
iast	3.23 ms [3.192 ms, 3.268 ms]	2.052 ms (174.2%)
iast_FULL	5.785 ms [5.727 ms, 5.843 ms]	4.607 ms (391.0%)
iast_GLOBAL	3.57 ms [3.514 ms, 3.626 ms]	2.392 ms (203.1%)
profiling	1.907 ms [1.891 ms, 1.922 ms]	728.774 µs (61.9%)
tracing	1.813 ms [1.797 ms, 1.83 ms]	635.316 µs (53.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.181 ms [1.17 ms, 1.193 ms]	-
iast	3.135 ms [3.098 ms, 3.172 ms]	1.953 ms (165.4%)
iast_FULL	5.829 ms [5.77 ms, 5.887 ms]	4.648 ms (393.5%)
iast_GLOBAL	3.652 ms [3.594 ms, 3.71 ms]	2.471 ms (209.2%)
profiling	1.974 ms [1.957 ms, 1.992 ms]	792.92 µs (67.1%)
tracing	1.804 ms [1.789 ms, 1.818 ms]	622.54 µs (52.7%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~ff22fa8767, baseline=1.58.0-SNAPSHOT~ab049bd23d
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.988 ms) : 17808, 18167
.   : milestone, 17988,
appsec (18.561 ms) : 18373, 18749
.   : milestone, 18561,
code_origins (18.047 ms) : 17870, 18224
.   : milestone, 18047,
iast (17.746 ms) : 17566, 17927
.   : milestone, 17746,
profiling (18.824 ms) : 18636, 19012
.   : milestone, 18824,
tracing (17.94 ms) : 17758, 18121
.   : milestone, 17940,
section candidate
no_agent (19.035 ms) : 18841, 19229
.   : milestone, 19035,
appsec (19.423 ms) : 19226, 19619
.   : milestone, 19423,
code_origins (17.853 ms) : 17672, 18034
.   : milestone, 17853,
iast (17.648 ms) : 17475, 17821
.   : milestone, 17648,
profiling (18.722 ms) : 18535, 18908
.   : milestone, 18722,
tracing (17.865 ms) : 17689, 18040
.   : milestone, 17865,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.988 ms [17.808 ms, 18.167 ms]	-
appsec	18.561 ms [18.373 ms, 18.749 ms]	573.035 µs (3.2%)
code_origins	18.047 ms [17.87 ms, 18.224 ms]	59.0 µs (0.3%)
iast	17.746 ms [17.566 ms, 17.927 ms]	-241.685 µs (-1.3%)
profiling	18.824 ms [18.636 ms, 19.012 ms]	835.894 µs (4.6%)
tracing	17.94 ms [17.758 ms, 18.121 ms]	-48.45 µs (-0.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.035 ms [18.841 ms, 19.229 ms]	-
appsec	19.423 ms [19.226 ms, 19.619 ms]	387.323 µs (2.0%)
code_origins	17.853 ms [17.672 ms, 18.034 ms]	-1.182 ms (-6.2%)
iast	17.648 ms [17.475 ms, 17.821 ms]	-1.387 ms (-7.3%)
profiling	18.722 ms [18.535 ms, 18.908 ms]	-313.642 µs (-1.6%)
tracing	17.865 ms [17.689 ms, 18.04 ms]	-1.17 ms (-6.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ygree/openai-java
git_commit_date	1766503833	1766521744
git_commit_sha	ab049bd23d	ff22fa8767
release_version	1.58.0-SNAPSHOT~ab049bd23d	1.55.0-SNAPSHOT~ff22fa8767

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1766523805	1766523805
ci_job_id	1316662173	1316662173
ci_pipeline_id	88228826	88228826
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-d0ja0j3r 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-d0ja0j3r 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~ff22fa8767, baseline=1.58.0-SNAPSHOT~ab049bd23d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1493
.   : milestone, 1481,
appsec (3.731 ms) : 3512, 3951
.   : milestone, 3731,
iast (2.216 ms) : 2151, 2280
.   : milestone, 2216,
iast_GLOBAL (2.264 ms) : 2198, 2330
.   : milestone, 2264,
profiling (2.084 ms) : 2030, 2138
.   : milestone, 2084,
tracing (2.043 ms) : 1992, 2094
.   : milestone, 2043,
section candidate
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (3.662 ms) : 3447, 3878
.   : milestone, 3662,
iast (2.214 ms) : 2149, 2278
.   : milestone, 2214,
iast_GLOBAL (2.263 ms) : 2198, 2329
.   : milestone, 2263,
profiling (2.073 ms) : 2020, 2126
.   : milestone, 2073,
tracing (2.055 ms) : 2003, 2106
.   : milestone, 2055,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.469 ms, 1.493 ms]	-
appsec	3.731 ms [3.512 ms, 3.951 ms]	2.25 ms (151.9%)
iast	2.216 ms [2.151 ms, 2.28 ms]	734.611 µs (49.6%)
iast_GLOBAL	2.264 ms [2.198 ms, 2.33 ms]	783.029 µs (52.9%)
profiling	2.084 ms [2.03 ms, 2.138 ms]	602.913 µs (40.7%)
tracing	2.043 ms [1.992 ms, 2.094 ms]	561.937 µs (37.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.469 ms, 1.492 ms]	-
appsec	3.662 ms [3.447 ms, 3.878 ms]	2.182 ms (147.4%)
iast	2.214 ms [2.149 ms, 2.278 ms]	733.488 µs (49.6%)
iast_GLOBAL	2.263 ms [2.198 ms, 2.329 ms]	783.386 µs (52.9%)
profiling	2.073 ms [2.02 ms, 2.126 ms]	592.976 µs (40.1%)
tracing	2.055 ms [2.003 ms, 2.106 ms]	574.514 µs (38.8%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~ff22fa8767, baseline=1.58.0-SNAPSHOT~ab049bd23d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.568 s) : 15568000, 15568000
.   : milestone, 15568000,
appsec (14.801 s) : 14801000, 14801000
.   : milestone, 14801000,
iast (18.611 s) : 18611000, 18611000
.   : milestone, 18611000,
iast_GLOBAL (17.68 s) : 17680000, 17680000
.   : milestone, 17680000,
profiling (14.828 s) : 14828000, 14828000
.   : milestone, 14828000,
tracing (14.6 s) : 14600000, 14600000
.   : milestone, 14600000,
section candidate
no_agent (15.172 s) : 15172000, 15172000
.   : milestone, 15172000,
appsec (14.92 s) : 14920000, 14920000
.   : milestone, 14920000,
iast (18.577 s) : 18577000, 18577000
.   : milestone, 18577000,
iast_GLOBAL (17.735 s) : 17735000, 17735000
.   : milestone, 17735000,
profiling (15.168 s) : 15168000, 15168000
.   : milestone, 15168000,
tracing (14.69 s) : 14690000, 14690000
.   : milestone, 14690000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.568 s [15.568 s, 15.568 s]	-
appsec	14.801 s [14.801 s, 14.801 s]	-767.0 ms (-4.9%)
iast	18.611 s [18.611 s, 18.611 s]	3.043 s (19.5%)
iast_GLOBAL	17.68 s [17.68 s, 17.68 s]	2.112 s (13.6%)
profiling	14.828 s [14.828 s, 14.828 s]	-740.0 ms (-4.8%)
tracing	14.6 s [14.6 s, 14.6 s]	-968.0 ms (-6.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.172 s [15.172 s, 15.172 s]	-
appsec	14.92 s [14.92 s, 14.92 s]	-252.0 ms (-1.7%)
iast	18.577 s [18.577 s, 18.577 s]	3.405 s (22.4%)
iast_GLOBAL	17.735 s [17.735 s, 17.735 s]	2.563 s (16.9%)
profiling	15.168 s [15.168 s, 15.168 s]	-4.0 ms (-0.0%)
tracing	14.69 s [14.69 s, 14.69 s]	-482.0 ms (-3.2%)

Nov 13 '25 22:11 pr-commenter[bot]

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

Dec 23 '25 21:12 github-actions[bot]

[WIP] openai-java v3.0+ instrumentation

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary