doris
doris copied to clipboard
Published
20 hours ago •
apache
apache
[feat](profile) support getting query progress
What problem does this PR solve?
Followup #50791
Add a new FE HTTP API: /rest/v2/manager/query/statistics/trace_id.
This API will return the query runtime statistic corresponding to a given trace id.
The query statistics includes info such as real-time scan rows/bytes.
Internally, Doris will get query id by trace id from all Frontends, and then fetch query statistics from BE.
Use pattern:
- User set custom trace id by:
set session_context="trace_id:my_trace_id" - User executes a query in same session
- Start a http client to get query statistics in real-time during the query process.
Also fix a bug in CoordinatorContext.java, to get real host. introduced from #41730
This PR also change the column name of information_schema.processlist table, to be same as column
name in show processlist.
Release note
None
Check List (For Author)
-
Test
- [x] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
-
Behavior changed:
- [ ] No.
- [x] Yes.
-
Does this need documentation?
- [ ] No.
- [x] Yes.
Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
- What problem was fixed (it's best to include specific error reporting information). How it was fixed.
- Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
- What features were added. Why was this function added?
- Which code was refactored and why was this part of the code refactored?
- Which functions were optimized and what is the difference before and after the optimization?
Cloud UT Coverage Report
Increment line coverage :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 83.31% (1118/1342) |
| Line Coverage | 66.77% (19137/28663) |
| Region Coverage | 66.36% (9463/14261) |
| Branch Coverage | 56.37% (5133/9106) |
TPC-H: Total hot run time: 34327 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 49535d5a9c071934746778c3e83b678827d243ea, data reload: false
------ Round 1 ----------------------------------
q1 26339 5198 5205 5198
q2 1979 303 197 197
q3 10364 1242 751 751
q4 10250 1039 550 550
q5 7661 2434 2323 2323
q6 206 165 134 134
q7 930 705 613 613
q8 9328 1285 1152 1152
q9 6826 5070 5116 5070
q10 6883 2344 1915 1915
q11 515 292 275 275
q12 358 373 224 224
q13 17771 3717 3142 3142
q14 233 245 220 220
q15 558 492 500 492
q16 434 431 393 393
q17 619 862 381 381
q18 7682 7214 7097 7097
q19 1956 982 593 593
q20 324 345 226 226
q21 4226 3251 2416 2416
q22 1034 1054 965 965
Total cold run time: 116476 ms
Total hot run time: 34327 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5404 5279 5432 5279
q2 254 323 224 224
q3 2158 2655 2296 2296
q4 1417 1909 1430 1430
q5 4452 4438 4371 4371
q6 212 173 131 131
q7 1992 1943 1755 1755
q8 2571 2542 2652 2542
q9 7274 7062 7111 7062
q10 2996 3198 2742 2742
q11 584 506 499 499
q12 697 769 611 611
q13 3617 3904 3461 3461
q14 282 302 266 266
q15 534 482 488 482
q16 451 489 453 453
q17 1164 1579 1392 1392
q18 7906 7568 7608 7568
q19 840 898 919 898
q20 1924 1976 1857 1857
q21 5005 4648 4503 4503
q22 1143 1065 1027 1027
Total cold run time: 52877 ms
Total hot run time: 50849 ms
TPC-DS: Total hot run time: 193134 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 49535d5a9c071934746778c3e83b678827d243ea, data reload: false
query1 1404 1108 1073 1073
query2 6267 1842 1868 1842
query3 11178 4516 4551 4516
query4 52968 24307 23065 23065
query5 5085 571 458 458
query6 338 201 217 201
query7 4881 504 289 289
query8 268 233 211 211
query9 5564 2681 2676 2676
query10 420 337 273 273
query11 15111 15083 14815 14815
query12 166 112 107 107
query13 1039 543 437 437
query14 10088 6384 6353 6353
query15 210 200 179 179
query16 7121 657 513 513
query17 1076 736 623 623
query18 1572 410 310 310
query19 195 192 161 161
query20 124 123 126 123
query21 213 127 114 114
query22 4296 4672 4294 4294
query23 34424 33730 33808 33730
query24 6680 2458 2437 2437
query25 468 484 403 403
query26 704 283 165 165
query27 2237 522 357 357
query28 2988 2255 2263 2255
query29 588 581 452 452
query30 279 220 190 190
query31 873 865 768 768
query32 73 63 62 62
query33 452 358 317 317
query34 783 871 538 538
query35 803 860 746 746
query36 959 1028 900 900
query37 112 105 84 84
query38 4323 4261 4272 4261
query39 1546 1462 1444 1444
query40 214 134 112 112
query41 69 61 62 61
query42 125 119 113 113
query43 500 520 492 492
query44 1386 867 864 864
query45 186 228 174 174
query46 881 1044 658 658
query47 1848 1891 1773 1773
query48 435 446 338 338
query49 663 509 417 417
query50 675 708 428 428
query51 4192 4239 4245 4239
query52 116 109 102 102
query53 242 261 192 192
query54 598 606 518 518
query55 90 87 88 87
query56 366 292 296 292
query57 1170 1178 1123 1123
query58 278 275 274 274
query59 2648 2752 2572 2572
query60 328 349 309 309
query61 129 131 138 131
query62 732 710 717 710
query63 239 195 201 195
query64 1678 1076 715 715
query65 4226 4155 4142 4142
query66 722 420 313 313
query67 16198 15690 15523 15523
query68 5923 932 545 545
query69 549 336 296 296
query70 1208 1090 1117 1090
query71 460 334 303 303
query72 6308 4938 5001 4938
query73 1376 749 365 365
query74 8941 8901 8749 8749
query75 3177 3219 2710 2710
query76 3900 1182 784 784
query77 539 394 296 296
query78 10311 10354 9213 9213
query79 2324 884 594 594
query80 607 531 464 464
query81 490 250 215 215
query82 448 131 97 97
query83 256 258 237 237
query84 295 108 88 88
query85 789 358 327 327
query86 374 311 287 287
query87 4418 4474 4349 4349
query88 3805 2300 2286 2286
query89 409 319 287 287
query90 1710 221 213 213
query91 142 145 118 118
query92 76 62 57 57
query93 1805 982 607 607
query94 727 423 303 303
query95 371 307 283 283
query96 517 582 284 284
query97 2745 2727 2669 2669
query98 255 211 211 211
query99 1413 1379 1260 1260
Total cold run time: 295478 ms
Total hot run time: 193134 ms
ClickBench: Total hot run time: 29.94 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 49535d5a9c071934746778c3e83b678827d243ea, data reload: false
query1 0.03 0.04 0.03
query2 0.15 0.11 0.11
query3 0.35 0.20 0.19
query4 1.58 0.19 0.20
query5 0.48 0.46 0.46
query6 1.15 0.66 0.66
query7 0.02 0.01 0.01
query8 0.05 0.05 0.05
query9 0.63 0.52 0.53
query10 0.58 0.59 0.58
query11 0.26 0.13 0.14
query12 0.26 0.14 0.13
query13 0.64 0.62 0.64
query14 0.79 0.83 0.82
query15 0.98 0.87 0.88
query16 0.38 0.37 0.38
query17 1.08 1.03 1.07
query18 0.20 0.19 0.18
query19 2.02 1.84 1.91
query20 0.01 0.01 0.01
query21 15.42 0.95 0.66
query22 0.93 1.05 0.76
query23 14.73 1.53 0.75
query24 5.42 0.58 0.29
query25 0.17 0.09 0.08
query26 0.56 0.23 0.19
query27 0.08 0.08 0.08
query28 11.00 1.24 0.58
query29 12.52 4.10 3.50
query30 0.29 0.10 0.07
query31 2.85 0.64 0.43
query32 3.22 0.60 0.50
query33 3.05 3.13 3.11
query34 16.80 5.17 4.47
query35 4.54 4.52 4.48
query36 0.63 0.52 0.50
query37 0.20 0.18 0.16
query38 0.17 0.16 0.16
query39 0.05 0.04 0.05
query40 0.20 0.17 0.18
query41 0.10 0.06 0.05
query42 0.07 0.06 0.06
query43 0.05 0.05 0.05
Total cold run time: 104.69 s
Total hot run time: 29.94 s
Cloud UT Coverage Report
Increment line coverage :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 83.31% (1118/1342) |
| Line Coverage | 66.76% (19135/28663) |
| Region Coverage | 66.33% (9460/14261) |
| Branch Coverage | 56.33% (5129/9106) |
TPC-H: Total hot run time: 33915 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 403624298cda81b301c1a26e6f33798be7a0e09e, data reload: false
------ Round 1 ----------------------------------
q1 26294 5122 5049 5049
q2 1972 281 186 186
q3 10599 1261 704 704
q4 10267 1013 532 532
q5 8381 2381 2370 2370
q6 186 163 129 129
q7 900 734 616 616
q8 9306 1322 1026 1026
q9 6783 5106 5120 5106
q10 6813 2343 1877 1877
q11 484 281 282 281
q12 341 349 210 210
q13 17777 3695 3048 3048
q14 237 226 214 214
q15 550 476 491 476
q16 436 432 377 377
q17 615 869 374 374
q18 7733 7317 7208 7208
q19 1916 958 582 582
q20 341 334 220 220
q21 3989 3112 2347 2347
q22 1047 1027 983 983
Total cold run time: 116967 ms
Total hot run time: 33915 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5136 5112 5069 5069
q2 249 316 218 218
q3 2160 2795 2329 2329
q4 1359 1807 1532 1532
q5 4500 4412 4321 4321
q6 211 189 128 128
q7 1987 1949 1764 1764
q8 2548 2529 2500 2500
q9 7106 7126 7260 7126
q10 3017 3170 2714 2714
q11 590 502 488 488
q12 675 766 604 604
q13 3413 3901 3299 3299
q14 299 294 277 277
q15 526 473 470 470
q16 440 488 427 427
q17 1163 1539 1369 1369
q18 7799 7519 7532 7519
q19 804 850 900 850
q20 2046 2029 1891 1891
q21 4863 4399 4296 4296
q22 1047 1036 982 982
Total cold run time: 51938 ms
Total hot run time: 50173 ms
TPC-DS: Total hot run time: 186017 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 403624298cda81b301c1a26e6f33798be7a0e09e, data reload: false
query1 1011 483 506 483
query2 6569 1841 1868 1841
query3 6768 222 217 217
query4 26248 23739 23354 23354
query5 4309 627 495 495
query6 328 207 210 207
query7 4629 507 300 300
query8 264 242 224 224
query9 8626 2642 2644 2642
query10 482 330 273 273
query11 15343 15000 14754 14754
query12 159 107 101 101
query13 1650 520 418 418
query14 8620 6001 6178 6001
query15 218 195 168 168
query16 7145 640 470 470
query17 934 748 584 584
query18 1981 406 302 302
query19 209 206 171 171
query20 129 117 120 117
query21 219 126 112 112
query22 4411 4333 4206 4206
query23 34156 33249 33123 33123
query24 8516 2387 2404 2387
query25 568 487 437 437
query26 1258 282 155 155
query27 2746 569 337 337
query28 4309 2159 2133 2133
query29 763 564 433 433
query30 282 212 192 192
query31 932 821 773 773
query32 72 65 62 62
query33 561 435 337 337
query34 794 843 539 539
query35 774 801 723 723
query36 918 966 879 879
query37 120 98 81 81
query38 4086 4056 4001 4001
query39 1471 1397 1425 1397
query40 207 120 107 107
query41 64 67 61 61
query42 132 111 114 111
query43 520 503 474 474
query44 1305 817 818 817
query45 176 172 165 165
query46 841 1024 634 634
query47 1812 1805 1761 1761
query48 386 424 308 308
query49 748 497 394 394
query50 666 680 397 397
query51 4111 4163 4088 4088
query52 117 109 107 107
query53 218 243 183 183
query54 572 566 500 500
query55 84 92 84 84
query56 318 299 286 286
query57 1131 1188 1103 1103
query58 264 255 255 255
query59 2574 2611 2590 2590
query60 333 318 314 314
query61 126 125 129 125
query62 806 714 661 661
query63 216 198 177 177
query64 4342 1033 669 669
query65 4246 4133 4144 4133
query66 1161 471 342 342
query67 15775 15765 15551 15551
query68 8842 886 522 522
query69 467 313 268 268
query70 1211 1149 1102 1102
query71 450 331 280 280
query72 5303 4686 4707 4686
query73 712 602 356 356
query74 8833 9062 8874 8874
query75 4166 3204 2683 2683
query76 3634 1221 749 749
query77 806 393 318 318
query78 10067 10272 9322 9322
query79 2470 835 580 580
query80 672 523 450 450
query81 469 267 216 216
query82 234 126 99 99
query83 299 259 239 239
query84 304 115 93 93
query85 760 422 316 316
query86 332 316 296 296
query87 4407 4448 4276 4276
query88 2865 2248 2259 2248
query89 414 305 279 279
query90 2071 203 200 200
query91 144 143 122 122
query92 76 62 57 57
query93 2065 952 587 587
query94 668 407 291 291
query95 372 291 279 279
query96 544 576 284 284
query97 2738 2740 2653 2653
query98 230 209 206 206
query99 1432 1413 1260 1260
Total cold run time: 273886 ms
Total hot run time: 186017 ms
ClickBench: Total hot run time: 28.71 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 403624298cda81b301c1a26e6f33798be7a0e09e, data reload: false
query1 0.04 0.04 0.03
query2 0.12 0.10 0.10
query3 0.25 0.19 0.20
query4 1.60 0.18 0.20
query5 0.45 0.42 0.45
query6 1.18 0.67 0.66
query7 0.03 0.02 0.02
query8 0.05 0.03 0.04
query9 0.58 0.53 0.52
query10 0.56 0.59 0.56
query11 0.16 0.12 0.11
query12 0.15 0.12 0.12
query13 0.61 0.60 0.60
query14 0.79 0.81 0.80
query15 0.90 0.89 0.87
query16 0.38 0.38 0.39
query17 1.04 1.07 1.05
query18 0.22 0.21 0.22
query19 1.98 1.89 1.77
query20 0.01 0.01 0.01
query21 15.42 0.91 0.55
query22 0.75 1.24 0.74
query23 14.79 1.39 0.61
query24 7.17 1.23 0.40
query25 0.51 0.23 0.07
query26 0.56 0.16 0.15
query27 0.06 0.05 0.04
query28 9.60 0.89 0.42
query29 12.57 4.06 3.30
query30 0.26 0.09 0.06
query31 2.83 0.59 0.39
query32 3.23 0.55 0.46
query33 2.96 3.04 3.03
query34 15.75 5.12 4.52
query35 4.49 4.52 4.55
query36 0.67 0.50 0.49
query37 0.08 0.06 0.06
query38 0.05 0.04 0.03
query39 0.03 0.03 0.03
query40 0.18 0.14 0.13
query41 0.08 0.03 0.03
query42 0.03 0.02 0.02
query43 0.04 0.04 0.03
Total cold run time: 103.21 s
Total hot run time: 28.71 s
BE UT Coverage Report
Increment line coverage 0.00% (0/21) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 56.06% (15031/26811) |
| Line Coverage | 44.95% (134184/298518) |
| Region Coverage | 44.08% (67525/153193) |
| Branch Coverage | 38.63% (34584/89532) |
BE Regression && UT Coverage Report
Increment line coverage 70.27% (26/37) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 79.57% (21002/26395) |
| Line Coverage | 72.65% (216880/298516) |
| Region Coverage | 70.87% (127653/180115) |
| Branch Coverage | 64.56% (66081/102358) |
Cloud UT Coverage Report
Increment line coverage :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 83.32% (1119/1343) |
| Line Coverage | 66.76% (19182/28732) |
| Region Coverage | 66.45% (9504/14302) |
| Branch Coverage | 56.40% (5153/9136) |
TPC-H: Total hot run time: 34002 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c1f1499127dbfe7274c3f2edc0bf2aa2809bad51, data reload: false
------ Round 1 ----------------------------------
q1 26144 5117 4992 4992
q2 1964 276 193 193
q3 10403 1249 711 711
q4 10236 1031 510 510
q5 7649 2409 2356 2356
q6 184 179 136 136
q7 935 755 625 625
q8 9315 1286 1182 1182
q9 6778 5076 5061 5061
q10 6879 2311 1897 1897
q11 507 295 277 277
q12 347 355 215 215
q13 17800 3766 3121 3121
q14 229 241 219 219
q15 576 499 513 499
q16 423 429 386 386
q17 597 865 369 369
q18 7647 7296 7121 7121
q19 1646 953 574 574
q20 338 360 222 222
q21 3872 3210 2384 2384
q22 1020 999 952 952
Total cold run time: 115489 ms
Total hot run time: 34002 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5189 5040 5084 5040
q2 243 314 240 240
q3 2180 2749 2347 2347
q4 1381 1767 1456 1456
q5 4491 4396 4453 4396
q6 220 175 137 137
q7 2044 1920 1788 1788
q8 2663 2707 2657 2657
q9 7234 7136 6897 6897
q10 3079 3195 2798 2798
q11 579 517 492 492
q12 665 775 669 669
q13 3501 3984 3320 3320
q14 295 295 285 285
q15 514 501 488 488
q16 445 493 438 438
q17 1175 1571 1388 1388
q18 7758 7500 7545 7500
q19 828 882 1052 882
q20 2042 2150 1867 1867
q21 4985 4704 4500 4500
q22 1093 1048 1038 1038
Total cold run time: 52604 ms
Total hot run time: 50623 ms
TPC-DS: Total hot run time: 193350 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c1f1499127dbfe7274c3f2edc0bf2aa2809bad51, data reload: false
query1 1433 1070 1058 1058
query2 6284 1860 1801 1801
query3 11039 4362 4272 4272
query4 55112 25379 23438 23438
query5 5131 509 499 499
query6 358 201 197 197
query7 4976 520 303 303
query8 275 222 200 200
query9 5755 2673 2705 2673
query10 452 331 280 280
query11 15157 15117 15021 15021
query12 166 121 118 118
query13 1085 532 408 408
query14 10247 6404 6538 6404
query15 199 207 179 179
query16 7097 688 494 494
query17 1085 778 614 614
query18 1544 424 318 318
query19 205 196 172 172
query20 139 137 125 125
query21 211 126 108 108
query22 4437 4294 4316 4294
query23 34305 33787 33757 33757
query24 6671 2443 2487 2443
query25 481 487 416 416
query26 723 269 151 151
query27 2274 519 350 350
query28 3013 2197 2182 2182
query29 571 569 457 457
query30 274 244 187 187
query31 876 855 774 774
query32 72 67 66 66
query33 468 380 329 329
query34 786 863 556 556
query35 811 845 755 755
query36 953 1011 891 891
query37 109 100 82 82
query38 4216 4366 4172 4172
query39 1502 1453 1476 1453
query40 210 131 113 113
query41 62 67 58 58
query42 128 116 112 112
query43 480 514 476 476
query44 1379 840 878 840
query45 188 175 171 171
query46 854 1030 665 665
query47 1803 1875 1789 1789
query48 402 451 339 339
query49 637 492 411 411
query50 681 694 410 410
query51 4263 4217 4273 4217
query52 119 113 102 102
query53 239 261 198 198
query54 600 587 510 510
query55 89 90 87 87
query56 311 343 281 281
query57 1158 1189 1108 1108
query58 277 276 268 268
query59 2622 2853 2688 2688
query60 337 330 333 330
query61 133 157 158 157
query62 791 773 695 695
query63 239 201 206 201
query64 1824 1038 671 671
query65 4264 4149 4134 4134
query66 735 403 307 307
query67 15902 15698 15316 15316
query68 7009 894 524 524
query69 566 307 273 273
query70 1155 1126 1150 1126
query71 485 327 312 312
query72 6083 4816 5025 4816
query73 1446 705 355 355
query74 9076 9286 8977 8977
query75 3890 3212 2719 2719
query76 4208 1200 760 760
query77 624 376 286 286
query78 10358 10262 9271 9271
query79 2119 778 577 577
query80 597 502 458 458
query81 483 256 211 211
query82 434 122 93 93
query83 259 255 238 238
query84 293 111 91 91
query85 779 353 315 315
query86 394 283 317 283
query87 4331 4473 4443 4443
query88 3601 2322 2285 2285
query89 397 312 280 280
query90 1778 209 231 209
query91 151 150 111 111
query92 77 62 63 62
query93 1766 942 589 589
query94 659 402 316 316
query95 364 298 278 278
query96 495 574 279 279
query97 2743 2724 2712 2712
query98 241 210 206 206
query99 1702 1396 1244 1244
Total cold run time: 299782 ms
Total hot run time: 193350 ms
ClickBench: Total hot run time: 29.77 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c1f1499127dbfe7274c3f2edc0bf2aa2809bad51, data reload: false
query1 0.04 0.04 0.04
query2 0.15 0.10 0.11
query3 0.34 0.19 0.19
query4 1.60 0.21 0.19
query5 0.46 0.45 0.46
query6 1.16 0.65 0.67
query7 0.02 0.02 0.01
query8 0.06 0.04 0.05
query9 0.63 0.52 0.52
query10 0.58 0.58 0.58
query11 0.26 0.13 0.13
query12 0.25 0.14 0.13
query13 0.64 0.61 0.62
query14 0.80 0.82 0.87
query15 0.96 0.87 0.89
query16 0.37 0.36 0.38
query17 1.05 1.06 1.04
query18 0.18 0.18 0.18
query19 1.93 1.84 1.84
query20 0.02 0.02 0.01
query21 15.41 0.97 0.67
query22 0.93 1.10 0.76
query23 14.72 1.56 0.77
query24 5.45 0.56 0.28
query25 0.16 0.09 0.09
query26 0.56 0.22 0.19
query27 0.09 0.08 0.08
query28 11.02 1.27 0.58
query29 12.56 4.13 3.44
query30 0.28 0.08 0.06
query31 2.81 0.63 0.42
query32 3.24 0.59 0.50
query33 3.12 3.10 3.11
query34 16.60 5.12 4.46
query35 4.48 4.44 4.46
query36 0.64 0.51 0.50
query37 0.20 0.17 0.17
query38 0.18 0.16 0.16
query39 0.05 0.04 0.04
query40 0.19 0.16 0.18
query41 0.11 0.05 0.04
query42 0.07 0.05 0.05
query43 0.05 0.05 0.05
Total cold run time: 104.42 s
Total hot run time: 29.77 s
Cloud UT Coverage Report
Increment line coverage :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 83.32% (1119/1343) |
| Line Coverage | 66.81% (19196/28732) |
| Region Coverage | 66.49% (9510/14302) |
| Branch Coverage | 56.44% (5156/9136) |
TPC-H: Total hot run time: 34175 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e1c29eb09b759a23a1b478f6a9ad9f9b9dba2308, data reload: false
------ Round 1 ----------------------------------
q1 27266 5057 5249 5057
q2 1982 288 198 198
q3 10381 1257 698 698
q4 10238 1032 550 550
q5 7727 2485 2291 2291
q6 186 168 133 133
q7 911 739 621 621
q8 9329 1307 1114 1114
q9 6900 5142 5092 5092
q10 6832 2343 1918 1918
q11 517 299 281 281
q12 343 355 230 230
q13 17817 3698 3103 3103
q14 231 229 226 226
q15 581 489 486 486
q16 429 452 381 381
q17 625 882 373 373
q18 7677 7290 7265 7265
q19 2448 1010 594 594
q20 343 344 222 222
q21 4133 2612 2357 2357
q22 1041 1030 985 985
Total cold run time: 117937 ms
Total hot run time: 34175 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5295 5093 5078 5078
q2 251 312 227 227
q3 2230 2728 2304 2304
q4 1527 1961 1521 1521
q5 4541 4435 4393 4393
q6 214 167 129 129
q7 2028 1925 1822 1822
q8 2586 2591 2557 2557
q9 7190 7211 7165 7165
q10 3043 3161 2765 2765
q11 593 528 515 515
q12 728 784 600 600
q13 3601 3893 3269 3269
q14 283 309 273 273
q15 527 494 492 492
q16 460 514 440 440
q17 1173 1621 1331 1331
q18 7746 7674 7495 7495
q19 856 867 956 867
q20 1970 2017 1867 1867
q21 4847 4475 4268 4268
q22 1054 1033 974 974
Total cold run time: 52743 ms
Total hot run time: 50352 ms
TPC-DS: Total hot run time: 187077 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e1c29eb09b759a23a1b478f6a9ad9f9b9dba2308, data reload: false
query1 1027 499 475 475
query2 6578 1884 1876 1876
query3 6746 231 222 222
query4 26009 23898 23556 23556
query5 4334 622 452 452
query6 298 191 198 191
query7 4627 515 288 288
query8 265 225 206 206
query9 8603 2675 2647 2647
query10 459 344 279 279
query11 15857 15071 15342 15071
query12 160 114 107 107
query13 1661 548 398 398
query14 9369 6154 6187 6154
query15 221 191 175 175
query16 7200 635 464 464
query17 1189 716 560 560
query18 1972 399 298 298
query19 186 181 156 156
query20 119 115 123 115
query21 223 133 108 108
query22 4095 4193 4237 4193
query23 34072 33248 33062 33062
query24 8526 2379 2402 2379
query25 533 445 389 389
query26 1243 285 155 155
query27 2742 507 341 341
query28 4316 2194 2133 2133
query29 786 575 439 439
query30 284 223 189 189
query31 947 883 785 785
query32 78 68 61 61
query33 538 389 314 314
query34 827 849 532 532
query35 797 797 747 747
query36 965 1015 872 872
query37 117 101 80 80
query38 4127 4251 4127 4127
query39 1508 1450 1448 1448
query40 219 124 112 112
query41 70 70 67 67
query42 131 114 112 112
query43 495 522 485 485
query44 1345 838 845 838
query45 187 179 183 179
query46 871 1041 645 645
query47 1762 1781 1725 1725
query48 402 430 335 335
query49 774 530 408 408
query50 695 676 414 414
query51 4187 4278 4133 4133
query52 108 112 99 99
query53 222 259 182 182
query54 587 574 507 507
query55 89 91 86 86
query56 316 324 295 295
query57 1129 1125 1080 1080
query58 264 263 264 263
query59 2679 2697 2555 2555
query60 342 325 313 313
query61 130 131 134 131
query62 782 726 647 647
query63 225 190 184 184
query64 4418 1022 695 695
query65 4254 4203 4256 4203
query66 1145 409 319 319
query67 15880 15495 15668 15495
query68 7945 910 534 534
query69 481 317 271 271
query70 1247 1157 1087 1087
query71 485 352 313 313
query72 5616 4906 4802 4802
query73 744 697 360 360
query74 9103 9123 8833 8833
query75 3831 3241 2716 2716
query76 3664 1228 763 763
query77 806 391 291 291
query78 9909 10207 9363 9363
query79 2550 850 600 600
query80 648 609 454 454
query81 505 257 226 226
query82 453 135 103 103
query83 298 263 239 239
query84 301 115 92 92
query85 802 369 327 327
query86 389 320 293 293
query87 4423 4519 4307 4307
query88 3782 2286 2300 2286
query89 385 316 290 290
query90 1838 233 213 213
query91 191 149 115 115
query92 83 68 59 59
query93 2043 966 597 597
query94 664 413 317 317
query95 388 293 287 287
query96 515 584 287 287
query97 2765 2839 2652 2652
query98 234 231 198 198
query99 1468 1403 1251 1251
Total cold run time: 275868 ms
Total hot run time: 187077 ms
ClickBench: Total hot run time: 29.11 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e1c29eb09b759a23a1b478f6a9ad9f9b9dba2308, data reload: false
query1 0.04 0.04 0.03
query2 0.13 0.10 0.10
query3 0.24 0.20 0.19
query4 1.59 0.22 0.19
query5 0.43 0.42 0.43
query6 1.17 0.66 0.66
query7 0.02 0.02 0.02
query8 0.05 0.03 0.03
query9 0.59 0.51 0.54
query10 0.56 0.57 0.56
query11 0.15 0.12 0.11
query12 0.15 0.12 0.11
query13 0.62 0.60 0.60
query14 0.79 0.79 0.81
query15 0.90 0.87 0.88
query16 0.38 0.38 0.37
query17 1.06 1.04 1.05
query18 0.23 0.21 0.21
query19 1.97 1.88 1.90
query20 0.02 0.01 0.01
query21 15.39 0.90 0.56
query22 0.76 1.30 0.68
query23 14.82 1.43 0.60
query24 6.72 2.05 0.62
query25 0.58 0.29 0.18
query26 0.67 0.17 0.14
query27 0.05 0.05 0.05
query28 9.72 0.93 0.45
query29 12.53 4.02 3.36
query30 0.25 0.10 0.06
query31 2.83 0.59 0.40
query32 3.23 0.56 0.49
query33 3.01 3.10 3.00
query34 15.87 5.08 4.51
query35 4.46 4.50 4.50
query36 0.71 0.50 0.49
query37 0.09 0.07 0.06
query38 0.05 0.04 0.04
query39 0.03 0.02 0.03
query40 0.17 0.14 0.13
query41 0.08 0.03 0.02
query42 0.04 0.02 0.02
query43 0.03 0.03 0.03
Total cold run time: 103.18 s
Total hot run time: 29.11 s
Cloud UT Coverage Report
Increment line coverage :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 83.33% (1120/1344) |
| Line Coverage | 66.80% (19312/28909) |
| Region Coverage | 66.56% (9578/14390) |
| Branch Coverage | 56.48% (5205/9216) |
FE UT Coverage Report
Increment line coverage 12.50% (18/144) :tada:
Increment coverage report
Complete coverage report
TPC-H: Total hot run time: 33903 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7acb9c168e9a8130c7d75a9a904d8501591e2e41, data reload: false
------ Round 1 ----------------------------------
q1 17627 5170 5032 5032
q2 1939 290 170 170
q3 10379 1226 749 749
q4 10215 1025 548 548
q5 7580 2225 2316 2225
q6 190 168 129 129
q7 910 745 646 646
q8 9313 1269 1065 1065
q9 6763 5091 5074 5074
q10 6842 2302 1904 1904
q11 500 293 288 288
q12 342 350 216 216
q13 17786 3641 3092 3092
q14 232 235 216 216
q15 553 479 479 479
q16 427 435 377 377
q17 603 852 385 385
q18 7832 7170 7263 7170
q19 2264 973 548 548
q20 331 344 232 232
q21 3673 3172 2375 2375
q22 1047 1038 983 983
Total cold run time: 107348 ms
Total hot run time: 33903 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5095 5022 5131 5022
q2 238 325 224 224
q3 2155 2646 2291 2291
q4 1342 1799 1332 1332
q5 4221 4116 4345 4116
q6 212 172 133 133
q7 2012 1904 1784 1784
q8 2598 2652 2552 2552
q9 7216 7147 7260 7147
q10 3005 3147 2664 2664
q11 584 519 514 514
q12 668 757 638 638
q13 3574 3853 3271 3271
q14 291 305 294 294
q15 533 487 476 476
q16 460 494 474 474
q17 1159 1559 1390 1390
q18 7881 7577 7474 7474
q19 790 794 811 794
q20 2029 2039 1921 1921
q21 5030 4407 4455 4407
q22 1102 1065 998 998
Total cold run time: 52195 ms
Total hot run time: 49916 ms
TPC-DS: Total hot run time: 192313 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7acb9c168e9a8130c7d75a9a904d8501591e2e41, data reload: false
query1 1421 1028 997 997
query2 6158 1805 1780 1780
query3 11017 4549 4482 4482
query4 57100 26642 22993 22993
query5 5153 516 465 465
query6 350 214 193 193
query7 4924 497 286 286
query8 287 216 209 209
query9 6001 2635 2642 2635
query10 445 327 293 293
query11 15205 14918 14781 14781
query12 157 109 118 109
query13 1078 545 417 417
query14 10190 6363 6388 6363
query15 217 212 176 176
query16 7208 646 466 466
query17 1109 759 595 595
query18 1720 420 318 318
query19 211 206 189 189
query20 133 121 121 121
query21 219 125 118 118
query22 4651 4581 4374 4374
query23 34246 33669 33640 33640
query24 6715 2455 2405 2405
query25 514 480 404 404
query26 685 269 155 155
query27 2224 518 369 369
query28 3061 2196 2208 2196
query29 572 563 445 445
query30 274 214 182 182
query31 858 867 776 776
query32 80 64 64 64
query33 452 385 327 327
query34 799 901 531 531
query35 812 841 752 752
query36 935 993 881 881
query37 112 107 79 79
query38 4265 4359 4255 4255
query39 1501 1474 1471 1471
query40 217 125 112 112
query41 59 56 74 56
query42 124 113 118 113
query43 497 503 477 477
query44 1381 862 871 862
query45 182 177 174 174
query46 864 1027 658 658
query47 1863 1891 1827 1827
query48 389 434 331 331
query49 620 492 415 415
query50 660 711 417 417
query51 4192 4232 4142 4142
query52 114 111 101 101
query53 230 262 194 194
query54 583 582 518 518
query55 84 90 81 81
query56 326 313 302 302
query57 1251 1230 1177 1177
query58 273 263 263 263
query59 2666 2798 2733 2733
query60 338 335 303 303
query61 131 122 120 120
query62 716 739 683 683
query63 244 196 194 194
query64 1800 1043 678 678
query65 4201 4142 4151 4142
query66 741 396 304 304
query67 16207 15598 15360 15360
query68 7850 892 527 527
query69 541 312 276 276
query70 1209 1119 1108 1108
query71 486 331 300 300
query72 5763 4742 4844 4742
query73 1436 650 363 363
query74 9080 9236 8627 8627
query75 3733 3232 2707 2707
query76 4287 1195 739 739
query77 621 371 296 296
query78 10162 10224 9352 9352
query79 2032 830 568 568
query80 741 520 443 443
query81 506 257 224 224
query82 452 124 97 97
query83 354 252 232 232
query84 287 100 94 94
query85 829 349 319 319
query86 414 296 293 293
query87 4334 4451 4404 4404
query88 3592 2304 2311 2304
query89 408 312 285 285
query90 1858 211 203 203
query91 148 153 113 113
query92 77 62 54 54
query93 1625 963 593 593
query94 649 419 311 311
query95 369 295 288 288
query96 491 563 278 278
query97 2720 2741 2648 2648
query98 232 218 201 201
query99 1438 1382 1295 1295
Total cold run time: 302736 ms
Total hot run time: 192313 ms
ClickBench: Total hot run time: 29.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7acb9c168e9a8130c7d75a9a904d8501591e2e41, data reload: false
query1 0.03 0.04 0.02
query2 0.10 0.05 0.05
query3 0.28 0.05 0.06
query4 1.59 0.08 0.08
query5 0.43 0.41 0.41
query6 1.16 0.65 0.67
query7 0.02 0.02 0.01
query8 0.06 0.05 0.05
query9 0.63 0.52 0.52
query10 0.57 0.58 0.58
query11 0.25 0.13 0.12
query12 0.26 0.14 0.13
query13 0.64 0.63 0.62
query14 0.80 0.86 0.83
query15 0.95 0.88 0.87
query16 0.37 0.37 0.36
query17 1.04 1.02 1.03
query18 0.18 0.18 0.18
query19 2.03 1.85 1.89
query20 0.02 0.01 0.01
query21 15.40 0.95 0.68
query22 0.93 1.09 0.77
query23 14.70 1.57 0.75
query24 5.54 0.55 0.28
query25 0.16 0.08 0.09
query26 0.57 0.22 0.18
query27 0.09 0.08 0.09
query28 11.01 1.20 0.56
query29 12.57 4.06 3.40
query30 0.29 0.08 0.06
query31 2.82 0.62 0.42
query32 3.26 0.60 0.50
query33 3.10 3.17 3.12
query34 16.45 5.12 4.46
query35 4.50 4.44 4.45
query36 0.63 0.50 0.49
query37 0.20 0.18 0.17
query38 0.17 0.17 0.15
query39 0.05 0.05 0.04
query40 0.21 0.17 0.15
query41 0.11 0.05 0.05
query42 0.06 0.06 0.05
query43 0.06 0.05 0.04
Total cold run time: 104.29 s
Total hot run time: 29.33 s