[improve](varbinary) support varbinary type with topn runtime filter
What problem does this PR solve?
Problem Summary: support varbinary with topn runtime filter eg: order by binary_col limit n and temp forbid varbinary type at: group by key, join key, comparison predicate in FE part.
Release note
None
Check List (For Author)
-
Test
- [x] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
-
Behavior changed:
- [x] No.
- [ ] Yes.
-
Does this need documentation?
- [x] No.
- [ ] Yes.
Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
- What problem was fixed (it's best to include specific error reporting information). How it was fixed.
- Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
- What features were added. Why was this function added?
- Which code was refactored and why was this part of the code refactored?
- Which functions were optimized and what is the difference before and after the optimization?
run buildall
TPC-H: Total hot run time: 34631 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1b2141b616ee6202ca5e8f0c64f3cffc6b5d3897, data reload: false
------ Round 1 ----------------------------------
q1 17621 5139 4936 4936
q2 2054 306 193 193
q3 10306 1337 737 737
q4 10195 788 318 318
q5 7524 2504 2158 2158
q6 196 177 139 139
q7 1008 785 651 651
q8 9357 1452 1104 1104
q9 7163 5329 5381 5329
q10 6877 2207 1764 1764
q11 527 326 293 293
q12 404 371 234 234
q13 17797 3681 3107 3107
q14 238 262 212 212
q15 598 521 522 521
q16 899 888 825 825
q17 710 793 557 557
q18 7852 7144 7176 7144
q19 1103 972 620 620
q20 380 356 225 225
q21 4081 3379 2599 2599
q22 1043 1001 965 965
Total cold run time: 107933 ms
Total hot run time: 34631 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4973 5013 4935 4935
q2 332 405 333 333
q3 2145 2704 2329 2329
q4 1395 1800 1320 1320
q5 4255 4545 4587 4545
q6 230 191 139 139
q7 2139 2032 1823 1823
q8 2663 2527 2698 2527
q9 7682 7455 7574 7455
q10 3061 3286 2845 2845
q11 596 525 494 494
q12 704 764 614 614
q13 3596 4009 3205 3205
q14 291 320 285 285
q15 547 506 526 506
q16 883 922 891 891
q17 1229 1509 1497 1497
q18 7977 7676 7573 7573
q19 945 905 922 905
q20 1980 1980 1823 1823
q21 4641 4279 4162 4162
q22 1119 1050 998 998
Total cold run time: 53383 ms
Total hot run time: 51204 ms
TPC-DS: Total hot run time: 180224 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1b2141b616ee6202ca5e8f0c64f3cffc6b5d3897, data reload: false
query5 4609 645 506 506
query6 359 235 209 209
query7 4664 480 273 273
query8 301 257 246 246
query9 8748 2661 2691 2661
query10 546 331 289 289
query11 15307 15048 14533 14533
query12 196 119 118 118
query13 1697 491 378 378
query14 6495 3301 3098 3098
query14_1 2904 2944 2888 2888
query15 211 194 188 188
query16 7624 499 474 474
query17 1250 738 622 622
query18 2090 440 352 352
query19 235 194 170 170
query20 135 120 125 120
query21 220 140 117 117
query22 3946 4123 3916 3916
query23 16714 16214 16102 16102
query23_1 16260 16020 16069 16020
query24 7184 1653 1217 1217
query24_1 1220 1211 1257 1211
query25 661 514 451 451
query26 1256 284 178 178
query27 2894 479 316 316
query28 4377 2206 2182 2182
query29 839 594 477 477
query30 314 243 215 215
query31 839 688 622 622
query32 88 71 72 71
query33 721 360 311 311
query34 924 901 550 550
query35 796 829 724 724
query36 897 920 846 846
query37 122 90 80 80
query38 3858 3872 3835 3835
query39 771 729 733 729
query39_1 710 705 697 697
query40 222 129 117 117
query41 65 63 63 63
query42 123 100 98 98
query43 443 421 403 403
query44 1340 774 763 763
query45 198 197 184 184
query46 909 989 612 612
query47 1691 1752 1635 1635
query48 396 329 232 232
query49 787 444 354 354
query50 698 319 239 239
query51 3859 3856 3981 3856
query52 119 97 84 84
query53 225 228 181 181
query54 318 258 253 253
query55 98 78 76 76
query56 329 298 287 287
query57 1176 1153 1125 1125
query58 298 265 253 253
query59 2412 2462 2336 2336
query60 364 315 306 306
query61 158 157 159 157
query62 796 676 636 636
query63 234 182 183 182
query64 4535 1164 905 905
query65 4021 3978 3939 3939
query66 1203 476 339 339
query67 15372 15190 14956 14956
query68 8247 942 666 666
query69 520 311 270 270
query70 1121 993 978 978
query71 456 296 272 272
query72 6164 4946 4990 4946
query73 693 588 300 300
query74 8819 8973 8607 8607
query75 3576 3023 2555 2555
query76 3543 1150 753 753
query77 816 408 302 302
query78 9450 9649 8862 8862
query79 1935 813 594 594
query80 659 554 461 461
query81 517 274 243 243
query82 497 135 105 105
query83 277 273 251 251
query84 265 108 98 98
query85 994 501 463 463
query86 387 325 297 297
query87 4010 4042 3979 3979
query88 4219 2158 2152 2152
query89 413 332 283 283
query90 2010 162 157 157
query91 172 164 144 144
query92 87 66 67 66
query93 1897 1056 675 675
query94 771 304 275 275
query95 582 372 334 334
query96 559 496 219 219
query97 2633 2689 2596 2596
query98 250 198 200 198
query99 1340 1317 1196 1196
Total cold run time: 273069 ms
Total hot run time: 180224 ms
ClickBench: Total hot run time: 27.26 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1b2141b616ee6202ca5e8f0c64f3cffc6b5d3897, data reload: false
query1 0.04 0.05 0.04
query2 0.10 0.05 0.04
query3 0.25 0.08 0.08
query4 1.61 0.11 0.11
query5 0.27 0.25 0.26
query6 1.14 0.64 0.64
query7 0.03 0.03 0.02
query8 0.05 0.04 0.04
query9 0.58 0.49 0.50
query10 0.56 0.57 0.55
query11 0.16 0.11 0.11
query12 0.14 0.12 0.12
query13 0.63 0.60 0.60
query14 1.03 0.98 0.99
query15 0.82 0.81 0.82
query16 0.38 0.40 0.41
query17 1.05 1.06 1.00
query18 0.24 0.22 0.22
query19 1.93 1.83 1.77
query20 0.01 0.02 0.01
query21 15.43 0.29 0.14
query22 4.78 0.05 0.05
query23 15.95 0.27 0.11
query24 1.36 0.47 0.20
query25 0.09 0.08 0.05
query26 0.15 0.13 0.14
query27 0.05 0.06 0.08
query28 3.96 1.21 1.02
query29 12.64 4.03 3.23
query30 0.28 0.14 0.11
query31 2.82 0.63 0.41
query32 3.24 0.56 0.47
query33 2.99 3.10 3.07
query34 16.76 5.16 4.56
query35 4.58 4.56 4.52
query36 0.68 0.49 0.49
query37 0.10 0.07 0.07
query38 0.07 0.04 0.04
query39 0.05 0.03 0.03
query40 0.16 0.14 0.13
query41 0.09 0.03 0.03
query42 0.04 0.03 0.03
query43 0.04 0.03 0.03
Total cold run time: 97.33 s
Total hot run time: 27.26 s
BE UT Coverage Report
Increment line coverage 12.79% (11/86) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 53.32% (18637/34955) |
| Line Coverage | 39.00% (172081/441270) |
| Region Coverage | 33.63% (133326/396466) |
| Branch Coverage | 34.57% (57344/165898) |
run buildall
TPC-H: Total hot run time: 34323 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1fc92d856f8a3304e11f18c747bea564a32b60d3, data reload: false
------ Round 1 ----------------------------------
q1 17669 5117 4926 4926
q2 2076 323 197 197
q3 10215 1329 748 748
q4 10224 840 327 327
q5 7521 2479 2119 2119
q6 183 175 143 143
q7 979 790 634 634
q8 9354 1417 1110 1110
q9 7330 5362 5358 5358
q10 6876 2222 1825 1825
q11 523 311 295 295
q12 392 377 227 227
q13 17814 3696 3050 3050
q14 237 241 211 211
q15 597 518 514 514
q16 880 861 814 814
q17 697 789 555 555
q18 7730 7268 6977 6977
q19 1118 988 599 599
q20 375 353 223 223
q21 4033 3397 2525 2525
q22 1059 1001 946 946
Total cold run time: 107882 ms
Total hot run time: 34323 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5030 4984 4974 4974
q2 319 414 330 330
q3 2176 2699 2267 2267
q4 1349 1760 1308 1308
q5 4252 4532 4559 4532
q6 230 184 133 133
q7 2120 1991 1820 1820
q8 2742 2562 2531 2531
q9 7597 7604 7520 7520
q10 3092 3342 2824 2824
q11 603 522 508 508
q12 672 731 616 616
q13 3611 3977 3275 3275
q14 308 307 310 307
q15 573 521 507 507
q16 930 947 884 884
q17 1213 1514 1462 1462
q18 8054 7630 7760 7630
q19 932 881 907 881
q20 2005 2094 1802 1802
q21 4615 4389 4105 4105
q22 1119 1062 1004 1004
Total cold run time: 53542 ms
Total hot run time: 51220 ms
TPC-DS: Total hot run time: 180612 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1fc92d856f8a3304e11f18c747bea564a32b60d3, data reload: false
query5 4621 632 497 497
query6 339 227 208 208
query7 4651 481 279 279
query8 325 260 236 236
query9 8755 2669 2663 2663
query10 544 331 285 285
query11 15141 14790 14970 14790
query12 177 123 116 116
query13 1701 498 388 388
query14 5905 3326 3044 3044
query14_1 2962 2984 2941 2941
query15 214 203 187 187
query16 7413 483 468 468
query17 1262 733 618 618
query18 2019 448 348 348
query19 224 192 167 167
query20 133 122 120 120
query21 217 139 116 116
query22 3908 3998 3850 3850
query23 16628 16198 15933 15933
query23_1 16073 16043 16285 16043
query24 7217 1672 1271 1271
query24_1 1218 1212 1238 1212
query25 661 513 461 461
query26 1272 283 184 184
query27 2876 470 317 317
query28 4404 2197 2181 2181
query29 888 603 508 508
query30 316 246 214 214
query31 800 728 633 633
query32 84 75 74 74
query33 664 340 301 301
query34 862 895 542 542
query35 797 828 747 747
query36 889 914 826 826
query37 124 98 77 77
query38 3871 3911 3835 3835
query39 754 744 719 719
query39_1 696 710 690 690
query40 221 133 119 119
query41 67 64 61 61
query42 124 99 100 99
query43 453 426 392 392
query44 1356 765 752 752
query45 197 194 184 184
query46 923 976 604 604
query47 1701 1735 1632 1632
query48 408 320 239 239
query49 783 423 354 354
query50 703 312 231 231
query51 3928 3854 3802 3802
query52 118 97 86 86
query53 243 237 182 182
query54 316 247 238 238
query55 98 88 78 78
query56 340 293 310 293
query57 1140 1139 1120 1120
query58 298 270 253 253
query59 2329 2437 2318 2318
query60 377 323 304 304
query61 163 159 195 159
query62 789 691 643 643
query63 236 180 182 180
query64 4572 1188 899 899
query65 4098 3995 3986 3986
query66 1254 456 337 337
query67 15422 14868 14910 14868
query68 8280 962 694 694
query69 523 303 268 268
query70 1115 999 1025 999
query71 462 295 283 283
query72 5996 4919 4891 4891
query73 691 560 308 308
query74 8874 8892 8673 8673
query75 3212 3051 2545 2545
query76 3405 1144 771 771
query77 645 418 297 297
query78 9500 9647 8926 8926
query79 1815 854 592 592
query80 705 552 490 490
query81 531 272 244 244
query82 202 133 105 105
query83 277 273 255 255
query84 266 128 95 95
query85 922 490 441 441
query86 377 307 288 288
query87 4096 4060 3904 3904
query88 3413 2176 2155 2155
query89 395 325 292 292
query90 2118 163 158 158
query91 172 169 147 147
query92 87 69 75 69
query93 2141 1032 680 680
query94 768 325 283 283
query95 565 344 331 331
query96 555 507 217 217
query97 2623 2661 2573 2573
query98 255 211 199 199
query99 1355 1345 1259 1259
Total cold run time: 270571 ms
Total hot run time: 180612 ms
ClickBench: Total hot run time: 27.5 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1fc92d856f8a3304e11f18c747bea564a32b60d3, data reload: false
query1 0.05 0.05 0.05
query2 0.11 0.06 0.05
query3 0.26 0.09 0.09
query4 1.61 0.11 0.11
query5 0.28 0.25 0.25
query6 1.16 0.64 0.65
query7 0.03 0.03 0.03
query8 0.06 0.05 0.04
query9 0.60 0.50 0.51
query10 0.56 0.55 0.56
query11 0.16 0.10 0.10
query12 0.15 0.12 0.12
query13 0.62 0.62 0.61
query14 0.99 0.98 1.00
query15 0.83 0.81 0.80
query16 0.42 0.41 0.43
query17 1.03 1.07 1.08
query18 0.23 0.21 0.20
query19 1.95 1.90 1.88
query20 0.02 0.01 0.01
query21 15.45 0.30 0.14
query22 4.70 0.06 0.05
query23 15.84 0.29 0.11
query24 1.18 0.64 0.19
query25 0.10 0.08 0.07
query26 0.14 0.13 0.13
query27 0.05 0.04 0.08
query28 4.47 1.26 1.03
query29 12.61 4.03 3.25
query30 0.28 0.14 0.12
query31 2.83 0.62 0.39
query32 3.24 0.56 0.48
query33 3.04 3.10 3.06
query34 16.91 5.25 4.53
query35 4.59 4.57 4.61
query36 0.67 0.51 0.48
query37 0.11 0.07 0.07
query38 0.07 0.05 0.04
query39 0.05 0.03 0.03
query40 0.16 0.14 0.13
query41 0.10 0.03 0.03
query42 0.04 0.03 0.03
query43 0.04 0.04 0.04
Total cold run time: 97.79 s
Total hot run time: 27.5 s
BE UT Coverage Report
Increment line coverage 12.79% (11/86) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 53.32% (18639/34956) |
| Line Coverage | 39.01% (172137/441276) |
| Region Coverage | 33.62% (133304/396467) |
| Branch Coverage | 34.58% (57365/165898) |
BE Regression && UT Coverage Report
Increment line coverage 15.12% (13/86) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 72.15% (24730/34276) |
| Line Coverage | 58.88% (259605/440890) |
| Region Coverage | 53.91% (216339/401279) |
| Branch Coverage | 55.36% (92332/166793) |
FE Regression Coverage Report
Increment line coverage 27.27% (3/11) :tada:
Increment coverage report
Complete coverage report
run buildall
TPC-H: Total hot run time: 34394 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 03d900d320e54160d50198193b6238e2ab16a16f, data reload: false
------ Round 1 ----------------------------------
q1 17643 5043 4866 4866
q2 1997 314 190 190
q3 10303 1345 718 718
q4 10231 949 321 321
q5 7579 2429 2183 2183
q6 185 171 136 136
q7 951 785 637 637
q8 9352 1461 1131 1131
q9 7138 5409 5375 5375
q10 6837 2213 1809 1809
q11 511 316 287 287
q12 351 360 223 223
q13 17782 3671 3027 3027
q14 237 254 211 211
q15 605 518 525 518
q16 912 859 819 819
q17 673 745 556 556
q18 7811 7080 7113 7080
q19 1102 955 607 607
q20 395 343 221 221
q21 4043 3332 2538 2538
q22 1060 1019 941 941
Total cold run time: 107698 ms
Total hot run time: 34394 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4942 4989 4899 4899
q2 336 402 325 325
q3 2158 2637 2332 2332
q4 1334 1742 1305 1305
q5 4231 4544 4530 4530
q6 227 183 134 134
q7 2013 1943 1774 1774
q8 2773 2610 2483 2483
q9 7558 7601 7520 7520
q10 3084 3255 2825 2825
q11 592 519 509 509
q12 683 742 600 600
q13 3505 3966 3270 3270
q14 281 309 279 279
q15 547 506 550 506
q16 874 944 919 919
q17 1171 1369 1410 1369
q18 7938 7842 7605 7605
q19 867 793 839 793
q20 1915 1966 1798 1798
q21 4583 4312 4095 4095
q22 1096 1043 1004 1004
Total cold run time: 52708 ms
Total hot run time: 50874 ms
run buildall
run buildall
FE UT Coverage Report
Increment line coverage 0.00% (0/11) :tada:
Increment coverage report
Complete coverage report
TPC-H: Total hot run time: 34293 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f5d350fcd0380a0459e54f533659e2c0011dfb8e, data reload: false
------ Round 1 ----------------------------------
q1 6090 4911 4925 4911
q2 687 308 195 195
q3 905 1293 724 724
q4 9058 815 320 320
q5 7575 2337 2262 2262
q6 198 178 137 137
q7 946 785 644 644
q8 9378 1447 1105 1105
q9 7147 5338 5199 5199
q10 6855 2208 1796 1796
q11 531 327 293 293
q12 353 370 222 222
q13 17815 3675 3005 3005
q14 231 229 211 211
q15 577 530 523 523
q16 908 869 819 819
q17 684 808 488 488
q18 7922 7183 7112 7112
q19 1021 969 591 591
q20 382 359 224 224
q21 3923 3267 2537 2537
q22 1027 1027 975 975
Total cold run time: 84213 ms
Total hot run time: 34293 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4939 4883 4884 4883
q2 329 418 312 312
q3 2155 2643 2281 2281
q4 1341 1780 1281 1281
q5 4217 4152 4122 4122
q6 203 164 125 125
q7 1874 1823 1670 1670
q8 2521 2411 2384 2384
q9 7026 6916 6998 6916
q10 2909 3079 2656 2656
q11 582 504 484 484
q12 628 695 549 549
q13 3245 3633 3024 3024
q14 278 283 266 266
q15 550 505 489 489
q16 860 901 843 843
q17 1118 1375 1350 1350
q18 7315 7081 7122 7081
q19 845 804 812 804
q20 1891 1965 1840 1840
q21 4645 4250 4057 4057
q22 1077 1043 1003 1003
Total cold run time: 50548 ms
Total hot run time: 48420 ms
TPC-DS: Total hot run time: 180033 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f5d350fcd0380a0459e54f533659e2c0011dfb8e, data reload: false
query5 5872 651 491 491
query6 421 235 210 210
query7 4911 476 276 276
query8 342 242 260 242
query9 8723 2639 2631 2631
query10 589 334 284 284
query11 15263 14750 14590 14590
query12 190 118 115 115
query13 1676 482 387 387
query14 7759 3302 3084 3084
query14_1 2919 2976 2973 2973
query15 262 206 198 198
query16 7743 488 488 488
query17 1531 770 613 613
query18 2048 447 354 354
query19 318 191 173 173
query20 133 124 117 117
query21 220 138 117 117
query22 3962 4010 3786 3786
query23 16556 16137 15988 15988
query23_1 15955 15949 16304 15949
query24 6554 1636 1247 1247
query24_1 1248 1201 1223 1201
query25 640 515 441 441
query26 1251 285 174 174
query27 2871 470 312 312
query28 4472 2182 2162 2162
query29 822 594 475 475
query30 323 247 213 213
query31 828 711 662 662
query32 86 71 71 71
query33 661 357 310 310
query34 852 934 541 541
query35 791 823 735 735
query36 898 906 861 861
query37 133 105 81 81
query38 3830 3967 3760 3760
query39 770 732 730 730
query39_1 787 706 686 686
query40 226 135 119 119
query41 65 62 59 59
query42 126 95 95 95
query43 438 420 384 384
query44 1314 759 759 759
query45 200 197 185 185
query46 904 971 586 586
query47 1657 1696 1628 1628
query48 405 325 231 231
query49 754 427 360 360
query50 704 320 234 234
query51 3777 3877 3865 3865
query52 118 100 85 85
query53 225 227 181 181
query54 318 257 243 243
query55 97 79 81 79
query56 337 303 299 299
query57 1157 1139 1083 1083
query58 311 268 259 259
query59 2359 2360 2411 2360
query60 364 318 302 302
query61 160 160 168 160
query62 770 687 613 613
query63 238 184 182 182
query64 4497 1164 904 904
query65 4063 3933 3938 3933
query66 1113 449 345 345
query67 15191 14869 14793 14793
query68 8410 964 662 662
query69 563 311 272 272
query70 1136 1043 969 969
query71 474 293 267 267
query72 5983 5075 4916 4916
query73 692 561 301 301
query74 8804 8717 8614 8614
query75 3519 3042 2571 2571
query76 3549 1143 732 732
query77 781 400 312 312
query78 9418 9600 8841 8841
query79 1714 860 590 590
query80 653 546 459 459
query81 535 271 240 240
query82 335 133 114 114
query83 283 275 258 258
query84 260 113 93 93
query85 886 492 452 452
query86 335 267 297 267
query87 4046 4017 3951 3951
query88 4229 2137 2152 2137
query89 410 342 285 285
query90 2002 172 166 166
query91 174 168 140 140
query92 91 67 64 64
query93 1877 1019 686 686
query94 732 309 282 282
query95 573 384 335 335
query96 543 509 216 216
query97 2643 2657 2612 2612
query98 250 206 195 195
query99 1342 1310 1235 1235
Total cold run time: 274096 ms
Total hot run time: 180033 ms
ClickBench: Total hot run time: 27.36 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f5d350fcd0380a0459e54f533659e2c0011dfb8e, data reload: false
query1 0.05 0.05 0.05
query2 0.10 0.05 0.04
query3 0.25 0.09 0.09
query4 1.61 0.11 0.11
query5 0.29 0.28 0.27
query6 1.18 0.65 0.63
query7 0.04 0.03 0.02
query8 0.06 0.04 0.05
query9 0.57 0.52 0.51
query10 0.57 0.56 0.55
query11 0.16 0.11 0.10
query12 0.15 0.11 0.11
query13 0.62 0.60 0.61
query14 0.98 0.99 0.97
query15 0.81 0.81 0.80
query16 0.40 0.41 0.40
query17 1.00 1.00 1.03
query18 0.26 0.21 0.21
query19 1.89 1.73 1.78
query20 0.02 0.01 0.01
query21 15.45 0.28 0.14
query22 4.98 0.05 0.05
query23 16.07 0.27 0.10
query24 1.47 1.08 0.21
query25 0.08 0.10 0.05
query26 0.14 0.12 0.13
query27 0.08 0.04 0.04
query28 4.85 1.22 1.01
query29 12.56 3.93 3.36
query30 0.31 0.13 0.12
query31 2.82 0.62 0.42
query32 3.23 0.55 0.46
query33 3.00 3.09 3.14
query34 17.01 5.12 4.56
query35 4.60 4.55 4.60
query36 0.65 0.49 0.49
query37 0.11 0.07 0.06
query38 0.07 0.05 0.04
query39 0.04 0.03 0.03
query40 0.16 0.13 0.15
query41 0.08 0.03 0.03
query42 0.04 0.03 0.03
query43 0.04 0.03 0.04
Total cold run time: 98.85 s
Total hot run time: 27.36 s
BE UT Coverage Report
Increment line coverage 12.79% (11/86) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 53.27% (18643/34999) |
| Line Coverage | 39.00% (172267/441732) |
| Region Coverage | 33.62% (133323/396578) |
| Branch Coverage | 34.58% (57372/165933) |
run buildall
TPC-H: Total hot run time: 34401 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 69c327e6af4da00f8cc66aa38b41b6a8a638c28b, data reload: false
------ Round 1 ----------------------------------
q1 17669 5189 4947 4947
q2 2067 316 194 194
q3 10274 1348 777 777
q4 10198 803 315 315
q5 7539 2410 2180 2180
q6 185 176 138 138
q7 948 809 650 650
q8 9370 1451 1155 1155
q9 7076 5310 5378 5310
q10 6849 2194 1769 1769
q11 542 318 300 300
q12 357 363 226 226
q13 17802 3725 3041 3041
q14 229 238 225 225
q15 597 511 509 509
q16 899 864 798 798
q17 699 860 443 443
q18 7538 7164 7057 7057
q19 925 956 604 604
q20 375 354 236 236
q21 4027 3715 2576 2576
q22 1055 976 951 951
Total cold run time: 107220 ms
Total hot run time: 34401 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4984 4968 4972 4968
q2 333 406 315 315
q3 2144 2686 2329 2329
q4 1323 1765 1323 1323
q5 4223 4548 4660 4548
q6 221 178 131 131
q7 2122 1963 1825 1825
q8 2704 2579 2539 2539
q9 7488 7462 7588 7462
q10 3091 3218 2855 2855
q11 624 507 486 486
q12 686 750 639 639
q13 3545 4017 3384 3384
q14 291 319 278 278
q15 530 568 507 507
q16 906 943 884 884
q17 1229 1547 1490 1490
q18 7962 7764 7683 7683
q19 913 882 909 882
q20 1961 2072 1985 1985
q21 4935 4324 4316 4316
q22 1080 1032 974 974
Total cold run time: 53295 ms
Total hot run time: 51803 ms
TPC-DS: Total hot run time: 180087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 69c327e6af4da00f8cc66aa38b41b6a8a638c28b, data reload: false
query5 5001 650 490 490
query6 359 250 209 209
query7 4663 479 288 288
query8 302 257 261 257
query9 8732 2664 2671 2664
query10 569 340 278 278
query11 15619 15174 14796 14796
query12 202 126 124 124
query13 1723 508 369 369
query14 7710 3238 3083 3083
query14_1 2888 2883 2873 2873
query15 204 203 184 184
query16 7698 487 457 457
query17 1612 740 630 630
query18 2054 451 347 347
query19 226 196 173 173
query20 129 127 121 121
query21 225 141 117 117
query22 4037 4094 4072 4072
query23 16803 16189 15887 15887
query23_1 16209 16001 15998 15998
query24 6823 1644 1205 1205
query24_1 1225 1193 1222 1193
query25 638 504 458 458
query26 1267 287 177 177
query27 2882 474 313 313
query28 4380 2219 2202 2202
query29 836 596 479 479
query30 323 247 222 222
query31 812 702 652 652
query32 93 71 118 71
query33 675 350 299 299
query34 869 901 528 528
query35 812 834 747 747
query36 874 920 830 830
query37 121 104 75 75
query38 3797 3849 3774 3774
query39 762 747 704 704
query39_1 714 708 700 700
query40 235 131 116 116
query41 66 63 63 63
query42 123 96 95 95
query43 427 419 400 400
query44 1301 755 759 755
query45 200 197 186 186
query46 911 957 602 602
query47 1676 1745 1621 1621
query48 405 327 230 230
query49 782 433 356 356
query50 694 297 236 236
query51 3853 3867 3900 3867
query52 118 104 84 84
query53 239 233 178 178
query54 313 280 237 237
query55 98 80 75 75
query56 342 293 308 293
query57 1208 1156 1099 1099
query58 322 257 253 253
query59 2328 2418 2360 2360
query60 379 318 296 296
query61 165 167 202 167
query62 781 703 646 646
query63 227 179 177 177
query64 4523 1193 917 917
query65 4034 3927 3989 3927
query66 1190 454 345 345
query67 15579 15227 14858 14858
query68 8430 934 668 668
query69 528 307 270 270
query70 1125 982 997 982
query71 486 289 276 276
query72 5940 4947 4905 4905
query73 696 554 298 298
query74 8881 8738 8527 8527
query75 3394 2998 2544 2544
query76 3508 1167 740 740
query77 792 408 301 301
query78 9456 9620 8904 8904
query79 1687 844 585 585
query80 659 601 473 473
query81 497 271 244 244
query82 689 131 104 104
query83 287 278 254 254
query84 258 122 98 98
query85 959 503 451 451
query86 345 294 275 275
query87 4063 3951 3967 3951
query88 3835 2123 2115 2115
query89 395 324 282 282
query90 2083 166 156 156
query91 182 169 146 146
query92 87 74 63 63
query93 1246 1045 680 680
query94 822 306 284 284
query95 563 382 325 325
query96 541 509 208 208
query97 2600 2685 2582 2582
query98 240 204 201 201
query99 1357 1314 1265 1265
Total cold run time: 273801 ms
Total hot run time: 180087 ms
ClickBench: Total hot run time: 27.13 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 69c327e6af4da00f8cc66aa38b41b6a8a638c28b, data reload: false
query1 0.05 0.05 0.05
query2 0.09 0.05 0.05
query3 0.25 0.09 0.09
query4 1.61 0.11 0.11
query5 0.29 0.26 0.26
query6 1.19 0.63 0.63
query7 0.03 0.02 0.02
query8 0.06 0.04 0.04
query9 0.58 0.50 0.50
query10 0.55 0.55 0.56
query11 0.16 0.10 0.11
query12 0.14 0.11 0.12
query13 0.62 0.59 0.61
query14 0.99 0.99 0.98
query15 0.82 0.79 0.81
query16 0.41 0.39 0.41
query17 1.10 1.00 1.05
query18 0.23 0.22 0.22
query19 1.87 1.86 1.85
query20 0.02 0.01 0.02
query21 15.45 0.29 0.14
query22 4.82 0.05 0.05
query23 16.07 0.28 0.10
query24 1.59 0.25 0.18
query25 0.09 0.05 0.06
query26 0.16 0.14 0.13
query27 0.06 0.05 0.04
query28 4.06 1.21 1.02
query29 12.62 3.97 3.17
query30 0.28 0.14 0.14
query31 2.82 0.63 0.40
query32 3.23 0.55 0.46
query33 2.99 3.00 3.10
query34 16.81 5.18 4.50
query35 4.57 4.56 4.60
query36 0.65 0.51 0.49
query37 0.11 0.07 0.06
query38 0.08 0.04 0.05
query39 0.05 0.04 0.03
query40 0.18 0.16 0.14
query41 0.10 0.04 0.03
query42 0.04 0.03 0.03
query43 0.04 0.03 0.04
Total cold run time: 97.93 s
Total hot run time: 27.13 s
run buildall
TPC-H: Total hot run time: 34282 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3ea3027aeb52950f741aec353ce3edac3c917d2e, data reload: false
------ Round 1 ----------------------------------
q1 17652 5050 4888 4888
q2 2035 303 192 192
q3 10280 1314 715 715
q4 10208 846 310 310
q5 7512 2492 2176 2176
q6 181 169 136 136
q7 974 810 656 656
q8 9349 1477 1165 1165
q9 7145 5288 5312 5288
q10 6855 2182 1763 1763
q11 500 321 289 289
q12 394 364 225 225
q13 17820 3675 3017 3017
q14 238 234 226 226
q15 590 517 513 513
q16 903 873 818 818
q17 698 859 461 461
q18 8145 7098 7048 7048
q19 1112 974 629 629
q20 385 340 224 224
q21 3961 3309 2581 2581
q22 1100 1025 962 962
Total cold run time: 108037 ms
Total hot run time: 34282 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4943 4927 4892 4892
q2 334 401 323 323
q3 2180 2663 2298 2298
q4 1310 1767 1305 1305
q5 4245 4623 4672 4623
q6 228 178 132 132
q7 2110 1988 1827 1827
q8 2760 2573 2632 2573
q9 7448 7559 7526 7526
q10 3069 3262 2930 2930
q11 604 518 522 518
q12 709 750 627 627
q13 3465 3944 3335 3335
q14 313 351 378 351
q15 615 533 523 523
q16 886 903 893 893
q17 1154 1476 1435 1435
q18 7765 7700 7560 7560
q19 883 858 846 846
q20 2032 2117 1890 1890
q21 4961 4394 4125 4125
q22 1126 1035 992 992
Total cold run time: 53140 ms
Total hot run time: 51524 ms
TPC-DS: Total hot run time: 179623 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3ea3027aeb52950f741aec353ce3edac3c917d2e, data reload: false
query5 5101 646 483 483
query6 339 218 199 199
query7 4675 467 273 273
query8 332 260 247 247
query9 8723 2646 2634 2634
query10 542 309 265 265
query11 15495 14907 14587 14587
query12 185 121 117 117
query13 1683 485 387 387
query14 6230 3273 2963 2963
query14_1 2915 2895 2917 2895
query15 203 195 180 180
query16 7707 493 463 463
query17 1212 718 613 613
query18 2043 433 338 338
query19 216 194 165 165
query20 133 121 119 119
query21 219 135 116 116
query22 3924 4014 3871 3871
query23 16519 16220 15936 15936
query23_1 16076 15935 15990 15935
query24 7280 1604 1216 1216
query24_1 1230 1208 1225 1208
query25 638 502 441 441
query26 1262 303 177 177
query27 2870 492 317 317
query28 4367 2204 2183 2183
query29 824 596 523 523
query30 317 242 208 208
query31 824 715 614 614
query32 84 67 65 65
query33 653 338 283 283
query34 874 868 519 519
query35 805 824 724 724
query36 879 926 824 824
query37 123 92 76 76
query38 3908 3892 3818 3818
query39 751 735 698 698
query39_1 705 695 692 692
query40 223 130 118 118
query41 66 62 63 62
query42 124 105 99 99
query43 430 424 399 399
query44 1298 782 765 765
query45 193 194 189 189
query46 905 966 597 597
query47 1710 1674 1630 1630
query48 409 320 231 231
query49 753 434 348 348
query50 681 308 238 238
query51 3974 3883 3862 3862
query52 113 95 83 83
query53 239 230 173 173
query54 312 254 234 234
query55 95 80 79 79
query56 326 284 294 284
query57 1138 1132 1087 1087
query58 282 255 256 255
query59 2364 2439 2380 2380
query60 370 320 291 291
query61 197 158 156 156
query62 786 651 648 648
query63 229 172 173 172
query64 4553 1205 899 899
query65 4051 3936 3991 3936
query66 1190 438 336 336
query67 15148 14951 14921 14921
query68 8463 944 668 668
query69 513 295 264 264
query70 1101 1003 954 954
query71 470 290 272 272
query72 6063 4944 4953 4944
query73 701 576 301 301
query74 8952 8865 8585 8585
query75 3355 3028 2496 2496
query76 3386 1125 743 743
query77 580 438 318 318
query78 9527 9509 8802 8802
query79 1586 913 575 575
query80 764 548 452 452
query81 515 273 232 232
query82 405 134 103 103
query83 278 270 255 255
query84 264 112 94 94
query85 898 492 451 451
query86 405 310 301 301
query87 3960 4090 3944 3944
query88 3383 2110 2116 2110
query89 391 326 278 278
query90 2068 164 155 155
query91 177 166 139 139
query92 87 67 65 65
query93 2496 993 685 685
query94 776 300 289 289
query95 571 386 330 330
query96 535 501 210 210
query97 2599 2647 2556 2556
query98 252 204 206 204
query99 1362 1319 1237 1237
Total cold run time: 271567 ms
Total hot run time: 179623 ms
ClickBench: Total hot run time: 27.37 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3ea3027aeb52950f741aec353ce3edac3c917d2e, data reload: false
query1 0.06 0.05 0.05
query2 0.10 0.05 0.05
query3 0.26 0.09 0.09
query4 1.60 0.11 0.11
query5 0.30 0.26 0.26
query6 1.17 0.66 0.63
query7 0.04 0.03 0.03
query8 0.06 0.04 0.04
query9 0.58 0.52 0.50
query10 0.55 0.55 0.56
query11 0.16 0.10 0.10
query12 0.15 0.12 0.12
query13 0.62 0.60 0.61
query14 1.02 0.99 1.01
query15 0.81 0.80 0.80
query16 0.39 0.40 0.43
query17 0.99 1.04 1.02
query18 0.23 0.21 0.22
query19 1.89 1.86 1.74
query20 0.01 0.01 0.01
query21 15.44 0.30 0.14
query22 4.58 0.05 0.05
query23 15.82 0.26 0.10
query24 1.63 0.60 0.50
query25 0.10 0.06 0.05
query26 0.14 0.14 0.13
query27 0.05 0.04 0.04
query28 5.00 1.17 1.01
query29 12.60 3.89 3.20
query30 0.28 0.16 0.12
query31 2.82 0.61 0.39
query32 3.23 0.55 0.46
query33 3.00 3.02 3.10
query34 16.75 5.14 4.50
query35 4.60 4.53 4.51
query36 0.68 0.50 0.49
query37 0.10 0.06 0.07
query38 0.07 0.04 0.04
query39 0.05 0.03 0.03
query40 0.17 0.15 0.14
query41 0.08 0.03 0.03
query42 0.04 0.03 0.03
query43 0.04 0.04 0.03
Total cold run time: 98.26 s
Total hot run time: 27.37 s