doris
doris copied to clipboard
apache
[only test] add local merge sort exchaner
Proposed changes
DATA_STREAM_SINK_OPERATOR (id=2,dst_id=2):
- BlocksProduced: sum 2, avg 1, max 2, min 0
- CloseTime: avg 50.194us, max 51.318us, min 49.71us
- ExecTime: avg 958.12us, max 1.625ms, min 290.750us
- InitTime: avg 100.283us, max 102.17us, min 98.550us
- InputRows: sum 40, avg 20, max 40, min 0
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 130.241us, max 150.198us, min 110.285us
- RowsProduced: sum 40, avg 20, max 40, min 0
- WaitForDependencyTime: avg 0ns, max 0ns, min 0ns
- WaitForRpcBufferQueue: avg 0ns, max 0ns, min 0ns
LOCAL_EXCHANGE_OPERATOR (LOCAL_MERGE_SORT) (id=-3):
- BlocksProduced: sum 2, avg 1, max 2, min 0
- CloseTime: avg 0ns, max 0ns, min 0ns
- ExecTime: avg 45.937us, max 82.162us, min 9.713us
- GetBlockFailedTime: sum 1, avg 0, max 1, min 0
- InitTime: avg 295ns, max 346ns, min 245ns
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 32.314us, max 56.419us, min 8.210us
- ProjectionTime: avg 0ns, max 0ns, min 0ns
- RowsProduced: sum 40, avg 20, max 40, min 0
- WaitForDependency[LOCAL_EXCHANGE_OPERATOR_DEPENDENCY]Time: avg 652.661ms, max 652.932ms, min 652.391ms
Pipeline : 1(instance_num=2):
LOCAL_EXCHANGE_SINK_OPERATOR (LOCAL_MERGE_SORT) (id=-3):
- CloseTime: avg 0ns, max 0ns, min 0ns
- ExecTime: avg 279.790us, max 472.726us, min 86.854us
- InitTime: avg 8.355us, max 8.367us, min 8.344us
- InputRows: sum 40, avg 20, max 20, min 20
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 5.676us, max 9.940us, min 1.412us
- WaitForDependency[LOCAL_EXCHANGE_SINK_DEPENDENCY]Time: avg 0ns, max 0ns, min 0ns
SORT_OPERATOR (id=1):
- PlanInfo
- order by: c_custkey ASC, c_name ASC
- TOPN OPT
- OPT TWO PHASE
- offset: 0
- limit: 20
- BlocksProduced: sum 2, avg 1, max 1, min 1
- CloseTime: avg 0ns, max 0ns, min 0ns
- ExecTime: avg 3.551us, max 3.817us, min 3.285us
- InitTime: avg 0ns, max 0ns, min 0ns
- MemoryUsage: sum , avg , max , min
- PeakMemoryUsage: sum 0.00 , avg 0.00 , max 0.00 , min 0.00
- OpenTime: avg 0ns, max 0ns, min 0ns
- ProjectionTime: avg 0ns, max 0ns, min 0ns
- RowsProduced: sum 40, avg 20, max 20, min 20
- WaitForDependency[SORT_OPERATOR_DEPENDENCY]Time: avg 651.110ms, max 653.23ms, min 649.198ms
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
TeamCity be ut coverage result: Function Coverage: 36.25% (9228/25455) Line Coverage: 27.61% (75679/274067) Region Coverage: 26.83% (39162/145987) Branch Coverage: 23.59% (19886/84298) Coverage Report: http://coverage.selectdb-in.cc/coverage/8fbbd3d233e9e3d74500482a4ff78d9a3159301f_8fbbd3d233e9e3d74500482a4ff78d9a3159301f/report/index.html
TPC-H: Total hot run time: 41880 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 50b465b84043e3291afdddbca1a854a2299bb18a, data reload: false
------ Round 1 ----------------------------------
q1 17620 4947 4263 4263
q2 2035 199 195 195
q3 10524 1170 1137 1137
q4 10199 748 822 748
q5 7491 2717 2711 2711
q6 221 131 137 131
q7 961 633 623 623
q8 9246 2183 2095 2095
q9 10006 6698 6777 6698
q10 9266 3955 3853 3853
q11 443 245 239 239
q12 506 230 227 227
q13 17475 3216 3209 3209
q14 273 216 224 216
q15 510 478 472 472
q16 492 407 398 398
q17 1001 756 708 708
q18 8434 7840 7710 7710
q19 4409 1633 1593 1593
q20 640 330 317 317
q21 5218 4065 4020 4020
q22 407 317 327 317
Total cold run time: 117377 ms
Total hot run time: 41880 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4571 4401 4384 4384
q2 386 272 267 267
q3 3154 2996 2915 2915
q4 1877 1634 1647 1634
q5 5522 5467 5510 5467
q6 213 121 125 121
q7 2198 1866 1824 1824
q8 3253 3402 3369 3369
q9 8670 8687 8688 8687
q10 3944 3752 3799 3752
q11 613 498 498 498
q12 800 644 641 641
q13 16021 3175 3200 3175
q14 290 288 260 260
q15 549 485 486 485
q16 500 431 438 431
q17 1829 1518 1472 1472
q18 7746 7579 7348 7348
q19 1682 1557 1554 1554
q20 2004 1823 1802 1802
q21 9978 4721 4828 4721
q22 619 519 530 519
Total cold run time: 76419 ms
Total hot run time: 55326 ms
TeamCity be ut coverage result: Function Coverage: 36.26% (9231/25455) Line Coverage: 27.62% (75702/274067) Region Coverage: 26.84% (39179/145989) Branch Coverage: 23.60% (19897/84300) Coverage Report: http://coverage.selectdb-in.cc/coverage/50b465b84043e3291afdddbca1a854a2299bb18a_50b465b84043e3291afdddbca1a854a2299bb18a/report/index.html
TPC-DS: Total hot run time: 169850 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 50b465b84043e3291afdddbca1a854a2299bb18a, data reload: false
query1 945 375 369 369
query2 6451 2524 2439 2439
query3 6645 212 211 211
query4 19440 17510 17386 17386
query5 4166 425 424 424
query6 245 164 155 155
query7 4585 304 290 290
query8 326 294 299 294
query9 8598 2413 2393 2393
query10 452 275 275 275
query11 10565 10042 10058 10042
query12 159 87 87 87
query13 1641 358 362 358
query14 10107 6823 6878 6823
query15 227 184 187 184
query16 7253 265 258 258
query17 1300 520 510 510
query18 1871 278 265 265
query19 201 158 148 148
query20 91 89 88 88
query21 210 138 133 133
query22 4330 3985 4111 3985
query23 33866 33112 33249 33112
query24 10912 2947 2842 2842
query25 581 357 364 357
query26 723 160 154 154
query27 2271 312 319 312
query28 5910 2074 2069 2069
query29 870 608 604 604
query30 242 152 153 152
query31 999 762 760 760
query32 91 53 55 53
query33 649 263 261 261
query34 868 468 477 468
query35 745 628 643 628
query36 1075 920 938 920
query37 109 69 72 69
query38 2995 2788 2887 2788
query39 876 821 821 821
query40 198 127 128 127
query41 54 52 52 52
query42 107 105 103 103
query43 588 587 573 573
query44 1114 736 754 736
query45 184 173 168 168
query46 1065 721 753 721
query47 1861 1754 1778 1754
query48 378 291 291 291
query49 855 386 381 381
query50 774 378 380 378
query51 6779 6537 6661 6537
query52 108 91 87 87
query53 357 297 289 289
query54 859 473 424 424
query55 76 74 74 74
query56 258 279 241 241
query57 1096 1017 1034 1017
query58 241 204 206 204
query59 3535 3134 3108 3108
query60 275 258 254 254
query61 91 84 87 84
query62 622 464 448 448
query63 314 283 290 283
query64 8492 2275 1721 1721
query65 3127 3112 3098 3098
query66 874 328 349 328
query67 15358 14865 14886 14865
query68 4573 561 547 547
query69 448 269 275 269
query70 1151 1081 1141 1081
query71 389 269 260 260
query72 7362 5460 2768 2768
query73 706 327 321 321
query74 6055 5687 5725 5687
query75 3326 2595 2618 2595
query76 2506 1029 934 934
query77 395 271 269 269
query78 10218 9750 9743 9743
query79 2591 514 514 514
query80 1064 428 421 421
query81 530 223 218 218
query82 726 93 95 93
query83 249 177 170 170
query84 252 85 86 85
query85 1441 273 280 273
query86 454 288 312 288
query87 3297 3112 3144 3112
query88 4250 2361 2363 2361
query89 475 403 377 377
query90 1999 194 257 194
query91 126 98 94 94
query92 60 47 48 47
query93 1758 511 500 500
query94 1202 186 186 186
query95 410 306 313 306
query96 603 262 263 262
query97 3208 3021 3000 3000
query98 230 227 214 214
query99 1164 843 828 828
Total cold run time: 266448 ms
Total hot run time: 169850 ms