What Does This Do
Tries to create a merge commit in GitLab based on the current commit and the closest base branch, and then builds that (this built artifact is used for Benchmark tests).
Motivation
If pull requests drift from the base branch, then the artifacts used for benchmarking and other testing are not representative of the resulting merge back of the PR. This also aligns with CircleCI where the tests are run on the merge commit.
Additional Notes
Benchmarks
Startup
Parameters
|
Baseline |
Candidate |
| commit |
1.22.0-SNAPSHOT~d95570f271 |
1.22.0-SNAPSHOT~a8bc89f5ce |
| config |
baseline |
candidate |
See matching parameters
|
Baseline |
Candidate |
| application |
insecure-bank |
insecure-bank |
| module |
Agent |
Agent |
| parent |
None |
None |
| variant |
appsec |
appsec |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 cases.
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.22.0-SNAPSHOT~a8bc89f5ce, baseline=1.22.0-SNAPSHOT~d95570f271
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.011 s) : 0, 1010854
Total [baseline] (9.231 s) : 0, 9231114
Agent [candidate] (1.011 s) : 0, 1010984
Total [candidate] (9.236 s) : 0, 9235929
section appsec
Agent [baseline] (1.1 s) : 0, 1099547
Total [baseline] (9.3 s) : 0, 9300312
Agent [candidate] (1.106 s) : 0, 1106231
Total [candidate] (9.269 s) : 0, 9268787
section iast
Agent [baseline] (1.129 s) : 0, 1128692
Total [baseline] (9.436 s) : 0, 9435825
Agent [candidate] (1.121 s) : 0, 1120547
Total [candidate] (9.34 s) : 0, 9339826
section profiling
Agent [baseline] (1.181 s) : 0, 1180957
Total [baseline] (9.391 s) : 0, 9390598
Agent [candidate] (1.192 s) : 0, 1191735
Total [candidate] (9.423 s) : 0, 9422961
| Module |
Variant |
Duration |
Δ tracing |
| Agent |
tracing |
1.011 s |
- |
| Agent |
appsec |
1.1 s |
88.693 ms (8.8%) |
| Agent |
iast |
1.129 s |
117.838 ms (11.7%) |
| Agent |
profiling |
1.181 s |
170.103 ms (16.8%) |
| Total |
tracing |
9.231 s |
- |
| Total |
appsec |
9.3 s |
69.198 ms (0.7%) |
| Total |
iast |
9.436 s |
204.711 ms (2.2%) |
| Total |
profiling |
9.391 s |
159.484 ms (1.7%) |
| Module |
Variant |
Duration |
Δ tracing |
| Agent |
tracing |
1.011 s |
- |
| Agent |
appsec |
1.106 s |
95.247 ms (9.4%) |
| Agent |
iast |
1.121 s |
109.564 ms (10.8%) |
| Agent |
profiling |
1.192 s |
180.752 ms (17.9%) |
| Total |
tracing |
9.236 s |
- |
| Total |
appsec |
9.269 s |
32.859 ms (0.4%) |
| Total |
iast |
9.34 s |
103.897 ms (1.1%) |
| Total |
profiling |
9.423 s |
187.032 ms (2.0%) |
gantt
title petclinic - break down per module: candidate=1.22.0-SNAPSHOT~a8bc89f5ce, baseline=1.22.0-SNAPSHOT~d95570f271
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (628.959 ms) : 0, 628959
BytebuddyAgent [candidate] (628.565 ms) : 0, 628565
GlobalTracer [baseline] (292.214 ms) : 0, 292214
GlobalTracer [candidate] (292.345 ms) : 0, 292345
AppSec [baseline] (48.765 ms) : 0, 48765
AppSec [candidate] (49.343 ms) : 0, 49343
Remote Config [baseline] (671.252 µs) : 0, 671
Remote Config [candidate] (655.528 µs) : 0, 656
Telemetry [baseline] (5.978 ms) : 0, 5978
Telemetry [candidate] (5.966 ms) : 0, 5966
section appsec
BytebuddyAgent [baseline] (629.452 ms) : 0, 629452
BytebuddyAgent [candidate] (633.31 ms) : 0, 633310
GlobalTracer [baseline] (291.744 ms) : 0, 291744
GlobalTracer [candidate] (293.751 ms) : 0, 293751
AppSec [baseline] (137.768 ms) : 0, 137768
AppSec [candidate] (138.238 ms) : 0, 138238
Remote Config [baseline] (639.236 µs) : 0, 639
Remote Config [candidate] (640.621 µs) : 0, 641
Telemetry [baseline] (5.752 ms) : 0, 5752
Telemetry [candidate] (5.77 ms) : 0, 5770
section iast
BytebuddyAgent [baseline] (748.689 ms) : 0, 748689
BytebuddyAgent [candidate] (741.925 ms) : 0, 741925
GlobalTracer [baseline] (278.47 ms) : 0, 278470
GlobalTracer [candidate] (277.104 ms) : 0, 277104
AppSec [baseline] (46.341 ms) : 0, 46341
AppSec [candidate] (46.518 ms) : 0, 46518
Remote Config [baseline] (559.037 µs) : 0, 559
Remote Config [candidate] (549.061 µs) : 0, 549
Telemetry [baseline] (5.771 ms) : 0, 5771
Telemetry [candidate] (5.8 ms) : 0, 5800
IAST [baseline] (14.401 ms) : 0, 14401
IAST [candidate] (14.365 ms) : 0, 14365
section profiling
BytebuddyAgent [baseline] (639.744 ms) : 0, 639744
BytebuddyAgent [candidate] (645.694 ms) : 0, 645694
GlobalTracer [baseline] (352.792 ms) : 0, 352792
GlobalTracer [candidate] (355.483 ms) : 0, 355483
AppSec [baseline] (49.001 ms) : 0, 49001
AppSec [candidate] (49.46 ms) : 0, 49460
Remote Config [baseline] (648.505 µs) : 0, 649
Remote Config [candidate] (651.338 µs) : 0, 651
Telemetry [baseline] (6.016 ms) : 0, 6016
Telemetry [candidate] (6.07 ms) : 0, 6070
ProfilingAgent [baseline] (79.796 ms) : 0, 79796
ProfilingAgent [candidate] (80.941 ms) : 0, 80941
Profiling [baseline] (79.82 ms) : 0, 79820
Profiling [candidate] (80.965 ms) : 0, 80965
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.22.0-SNAPSHOT~a8bc89f5ce, baseline=1.22.0-SNAPSHOT~d95570f271
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.01 s) : 0, 1010446
Total [baseline] (8.649 s) : 0, 8649153
Agent [candidate] (1.02 s) : 0, 1020087
Total [candidate] (8.673 s) : 0, 8672743
section appsec
Agent [baseline] (1.107 s) : 0, 1106542
Total [baseline] (8.768 s) : 0, 8767793
Agent [candidate] (1.1 s) : 0, 1100416
Total [candidate] (8.719 s) : 0, 8718550
section iast
Agent [baseline] (1.123 s) : 0, 1123097
Total [baseline] (9.199 s) : 0, 9198687
Agent [candidate] (1.133 s) : 0, 1133305
Total [candidate] (9.169 s) : 0, 9169309
section profiling
Agent [baseline] (1.197 s) : 0, 1197012
Total [baseline] (8.871 s) : 0, 8870583
Agent [candidate] (1.185 s) : 0, 1184895
Total [candidate] (8.887 s) : 0, 8887336
| Module |
Variant |
Duration |
Δ tracing |
| Agent |
tracing |
1.01 s |
- |
| Agent |
appsec |
1.107 s |
96.097 ms (9.5%) |
| Agent |
iast |
1.123 s |
112.651 ms (11.1%) |
| Agent |
profiling |
1.197 s |
186.566 ms (18.5%) |
| Total |
tracing |
8.649 s |
- |
| Total |
appsec |
8.768 s |
118.64 ms (1.4%) |
| Total |
iast |
9.199 s |
549.534 ms (6.4%) |
| Total |
profiling |
8.871 s |
221.43 ms (2.6%) |
| Module |
Variant |
Duration |
Δ tracing |
| Agent |
tracing |
1.02 s |
- |
| Agent |
appsec |
1.1 s |
80.329 ms (7.9%) |
| Agent |
iast |
1.133 s |
113.218 ms (11.1%) |
| Agent |
profiling |
1.185 s |
164.809 ms (16.2%) |
| Total |
tracing |
8.673 s |
- |
| Total |
appsec |
8.719 s |
45.807 ms (0.5%) |
| Total |
iast |
9.169 s |
496.566 ms (5.7%) |
| Total |
profiling |
8.887 s |
214.593 ms (2.5%) |
gantt
title insecure-bank - break down per module: candidate=1.22.0-SNAPSHOT~a8bc89f5ce, baseline=1.22.0-SNAPSHOT~d95570f271
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (628.572 ms) : 0, 628572
BytebuddyAgent [candidate] (634.012 ms) : 0, 634012
GlobalTracer [baseline] (291.924 ms) : 0, 291924
GlobalTracer [candidate] (295.297 ms) : 0, 295297
AppSec [baseline] (48.94 ms) : 0, 48940
AppSec [candidate] (49.437 ms) : 0, 49437
Remote Config [baseline] (661.56 µs) : 0, 662
Remote Config [candidate] (665.194 µs) : 0, 665
Telemetry [baseline] (6.009 ms) : 0, 6009
Telemetry [candidate] (6.117 ms) : 0, 6117
section appsec
BytebuddyAgent [baseline] (634.754 ms) : 0, 634754
BytebuddyAgent [candidate] (629.585 ms) : 0, 629585
GlobalTracer [baseline] (292.994 ms) : 0, 292994
GlobalTracer [candidate] (292.857 ms) : 0, 292857
AppSec [baseline] (137.992 ms) : 0, 137992
AppSec [candidate] (137.473 ms) : 0, 137473
Remote Config [baseline] (646.171 µs) : 0, 646
Remote Config [candidate] (635.669 µs) : 0, 636
Telemetry [baseline] (5.779 ms) : 0, 5779
Telemetry [candidate] (5.73 ms) : 0, 5730
section iast
BytebuddyAgent [baseline] (744.025 ms) : 0, 744025
BytebuddyAgent [candidate] (751.212 ms) : 0, 751212
GlobalTracer [baseline] (277.362 ms) : 0, 277362
GlobalTracer [candidate] (279.667 ms) : 0, 279667
AppSec [baseline] (46.534 ms) : 0, 46534
AppSec [candidate] (46.974 ms) : 0, 46974
Remote Config [baseline] (558.066 µs) : 0, 558
Remote Config [candidate] (559.159 µs) : 0, 559
Telemetry [baseline] (5.815 ms) : 0, 5815
Telemetry [candidate] (5.824 ms) : 0, 5824
IAST [baseline] (14.472 ms) : 0, 14472
IAST [candidate] (14.484 ms) : 0, 14484
section profiling
BytebuddyAgent [baseline] (649.085 ms) : 0, 649085
BytebuddyAgent [candidate] (641.868 ms) : 0, 641868
GlobalTracer [baseline] (357.558 ms) : 0, 357558
GlobalTracer [candidate] (353.886 ms) : 0, 353886
AppSec [baseline] (49.29 ms) : 0, 49290
AppSec [candidate] (49.208 ms) : 0, 49208
Remote Config [baseline] (659.26 µs) : 0, 659
Remote Config [candidate] (692.962 µs) : 0, 693
Telemetry [baseline] (6.115 ms) : 0, 6115
Telemetry [candidate] (6.002 ms) : 0, 6002
ProfilingAgent [baseline] (80.62 ms) : 0, 80620
ProfilingAgent [candidate] (80.159 ms) : 0, 80159
Profiling [baseline] (80.647 ms) : 0, 80647
Profiling [candidate] (80.185 ms) : 0, 80185
Load
Parameters
|
Baseline |
Candidate |
| commit |
1.22.0-SNAPSHOT~d95570f271 |
1.22.0-SNAPSHOT~a8bc89f5ce |
| config |
baseline |
candidate |
| end_time |
2023-10-05T08:16:15 |
2023-10-05T08:34:23 |
| start_time |
2023-10-05T08:15:57 |
2023-10-05T08:34:04 |
See matching parameters
|
Baseline |
Candidate |
| application |
insecure-bank |
insecure-bank |
| variant |
appsec |
appsec |
Summary
Found 0 performance improvements and 0 performance regressions! Performance is the same for 24 cases.
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.22.0-SNAPSHOT~a8bc89f5ce, baseline=1.22.0-SNAPSHOT~d95570f271
dateFormat X
axisFormat %s
section baseline
no_agent (1.345 ms) : 1326, 1363
. : milestone, 1345,
appsec (1.659 ms) : 1634, 1683
. : milestone, 1659,
iast (1.441 ms) : 1417, 1465
. : milestone, 1441,
profiling (1.473 ms) : 1447, 1499
. : milestone, 1473,
tracing (1.449 ms) : 1424, 1474
. : milestone, 1449,
section candidate
no_agent (1.326 ms) : 1307, 1345
. : milestone, 1326,
appsec (1.701 ms) : 1677, 1726
. : milestone, 1701,
iast (1.463 ms) : 1439, 1487
. : milestone, 1463,
profiling (1.485 ms) : 1461, 1510
. : milestone, 1485,
tracing (1.424 ms) : 1399, 1448
. : milestone, 1424,
| Variant |
Request duration [CI 0.99] |
Δ no_agent |
| no_agent |
1.345 ms [1.326 ms, 1.363 ms] |
- |
| appsec |
1.659 ms [1.634 ms, 1.683 ms] |
314.347 µs (23.4%) |
| iast |
1.441 ms [1.417 ms, 1.465 ms] |
96.315 µs (7.2%) |
| profiling |
1.473 ms [1.447 ms, 1.499 ms] |
128.708 µs (9.6%) |
| tracing |
1.449 ms [1.424 ms, 1.474 ms] |
104.455 µs (7.8%) |
| Variant |
Request duration [CI 0.99] |
Δ no_agent |
| no_agent |
1.326 ms [1.307 ms, 1.345 ms] |
- |
| appsec |
1.701 ms [1.677 ms, 1.726 ms] |
375.508 µs (28.3%) |
| iast |
1.463 ms [1.439 ms, 1.487 ms] |
136.794 µs (10.3%) |
| profiling |
1.485 ms [1.461 ms, 1.51 ms] |
159.526 µs (12.0%) |
| tracing |
1.424 ms [1.399 ms, 1.448 ms] |
97.961 µs (7.4%) |
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.22.0-SNAPSHOT~a8bc89f5ce, baseline=1.22.0-SNAPSHOT~d95570f271
dateFormat X
axisFormat %s
section baseline
no_agent (363.662 µs) : 343, 384
. : milestone, 364,
appsec (684.436 µs) : 664, 705
. : milestone, 684,
iast (458.416 µs) : 438, 479
. : milestone, 458,
iast_FULL (522.761 µs) : 502, 544
. : milestone, 523,
iast_INACTIVE (434.303 µs) : 413, 455
. : milestone, 434,
profiling (432.731 µs) : 413, 453
. : milestone, 433,
tracing (432.469 µs) : 411, 454
. : milestone, 432,
section candidate
no_agent (367.832 µs) : 345, 391
. : milestone, 368,
appsec (693.279 µs) : 673, 714
. : milestone, 693,
iast (457.079 µs) : 436, 478
. : milestone, 457,
iast_FULL (518.211 µs) : 498, 539
. : milestone, 518,
iast_INACTIVE (426.143 µs) : 406, 447
. : milestone, 426,
profiling (436.595 µs) : 415, 458
. : milestone, 437,
tracing (433.132 µs) : 412, 454
. : milestone, 433,
| Variant |
Request duration [CI 0.99] |
Δ no_agent |
| no_agent |
363.662 µs [342.937 µs, 384.387 µs] |
- |
| appsec |
684.436 µs [664.245 µs, 704.627 µs] |
320.774 µs (88.2%) |
| iast |
458.416 µs [437.725 µs, 479.106 µs] |
94.754 µs (26.1%) |
| iast_FULL |
522.761 µs [501.868 µs, 543.654 µs] |
159.099 µs (43.7%) |
| iast_INACTIVE |
434.303 µs [413.283 µs, 455.322 µs] |
70.641 µs (19.4%) |
| profiling |
432.731 µs [412.536 µs, 452.926 µs] |
69.069 µs (19.0%) |
| tracing |
432.469 µs [410.953 µs, 453.985 µs] |
68.807 µs (18.9%) |
| Variant |
Request duration [CI 0.99] |
Δ no_agent |
| no_agent |
367.832 µs [344.932 µs, 390.731 µs] |
- |
| appsec |
693.279 µs [672.871 µs, 713.686 µs] |
325.447 µs (88.5%) |
| iast |
457.079 µs [436.076 µs, 478.082 µs] |
89.248 µs (24.3%) |
| iast_FULL |
518.211 µs [497.703 µs, 538.719 µs] |
150.379 µs (40.9%) |
| iast_INACTIVE |
426.143 µs [405.502 µs, 446.783 µs] |
58.311 µs (15.9%) |
| profiling |
436.595 µs [415.499 µs, 457.692 µs] |
68.764 µs (18.7%) |
| tracing |
433.132 µs [412.332 µs, 453.932 µs] |
65.3 µs (17.8%) |
dd-trace-java copied to clipboard
DataDog
![pr-commenter[bot] avatar](https://avatars.githubusercontent.com/u/365230?v=4 "Published by a pub.dev verified publisher"){kind=small}