doris
doris copied to clipboard
Published
20 hours ago •
apache
apache
branch-3.1 [o[opt](nereids) infer in-predicate from or-predicate (#46468)
What problem does this PR solve?
pick #41222 #46468 #44574 #48034 #50265
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
Release note
None
Check List (For Author)
-
Test
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
-
Behavior changed:
- [ ] No.
- [ ] Yes.
-
Does this need documentation?
- [ ] No.
- [ ] Yes.
Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
- What problem was fixed (it's best to include specific error reporting information). How it was fixed.
- Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
- What features were added. Why was this function added?
- Which code was refactored and why was this part of the code refactored?
- Which functions were optimized and what is the difference before and after the optimization?
TPC-H: Total hot run time: 41124 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d61f5d4b662923462dc8062890163e8a66ec2837, data reload: false
------ Round 1 ----------------------------------
q1 17579 7095 6943 6943
q2 2077 176 168 168
q3 10544 1206 1247 1206
q4 10216 800 816 800
q5 7770 2999 2880 2880
q6 244 139 138 138
q7 1030 619 622 619
q8 9353 2109 2103 2103
q9 7035 6690 6638 6638
q10 7105 2298 2319 2298
q11 469 262 269 262
q12 545 215 209 209
q13 17779 3015 2990 2990
q14 241 209 203 203
q15 523 464 464 464
q16 493 372 372 372
q17 1015 578 606 578
q18 7326 6634 6671 6634
q19 1347 1129 1154 1129
q20 522 209 201 201
q21 4116 3469 3316 3316
q22 1088 1008 973 973
Total cold run time: 108417 ms
Total hot run time: 41124 ms
----- Round 2, with runtime_filter_mode=off -----
q1 6801 6820 6845 6820
q2 344 231 226 226
q3 2984 2865 2885 2865
q4 2036 1823 1717 1717
q5 5556 5570 5598 5570
q6 223 129 129 129
q7 2182 1715 1692 1692
q8 3455 3674 3690 3674
q9 8679 8646 8611 8611
q10 3557 3545 3532 3532
q11 627 487 472 472
q12 795 564 570 564
q13 10529 3014 3042 3014
q14 298 255 245 245
q15 503 461 474 461
q16 488 419 415 415
q17 1958 1678 1662 1662
q18 7875 7451 7442 7442
q19 1847 1800 1738 1738
q20 2137 1798 1797 1797
q21 5274 5000 5072 5000
q22 1117 1010 993 993
Total cold run time: 69265 ms
Total hot run time: 58639 ms
TPC-DS: Total hot run time: 190205 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d61f5d4b662923462dc8062890163e8a66ec2837, data reload: false
query1 973 389 369 369
query2 2846 2012 2008 2008
query3 6562 212 215 212
query4 33171 23591 24018 23591
query5 2157 447 446 446
query6 262 175 178 175
query7 4622 304 320 304
query8 305 230 231 230
query9 9502 2618 2582 2582
query10 495 271 264 264
query11 18207 15270 15307 15270
query12 169 103 101 101
query13 1642 437 419 419
query14 8806 6784 6717 6717
query15 237 172 183 172
query16 7542 469 486 469
query17 1625 585 566 566
query18 1902 306 318 306
query19 259 173 157 157
query20 122 106 110 106
query21 210 106 106 106
query22 4396 4082 4040 4040
query23 34486 33577 33253 33253
query24 12886 2886 2844 2844
query25 613 405 408 405
query26 1096 170 176 170
query27 3028 355 349 349
query28 7711 2130 2120 2120
query29 703 449 440 440
query30 261 161 160 160
query31 1052 812 809 809
query32 85 64 61 61
query33 769 318 322 318
query34 906 522 534 522
query35 867 730 734 730
query36 1102 951 958 951
query37 175 73 70 70
query38 3972 3863 3862 3862
query39 1469 1420 1436 1420
query40 222 103 105 103
query41 53 49 50 49
query42 121 107 109 107
query43 528 489 489 489
query44 1289 825 814 814
query45 189 174 179 174
query46 1135 719 712 712
query47 1942 1854 1846 1846
query48 431 352 367 352
query49 909 427 422 422
query50 817 422 420 420
query51 7134 7196 7121 7121
query52 108 96 95 95
query53 270 186 196 186
query54 1220 474 478 474
query55 83 83 79 79
query56 285 286 298 286
query57 1262 1145 1183 1145
query58 234 222 225 222
query59 3149 3073 2873 2873
query60 287 260 259 259
query61 115 113 113 113
query62 908 684 662 662
query63 221 190 191 190
query64 3938 648 644 644
query65 3271 3224 3191 3191
query66 787 315 305 305
query67 15898 15399 15429 15399
query68 4729 614 577 577
query69 424 283 269 269
query70 1204 1119 1124 1119
query71 344 272 259 259
query72 5588 3993 3990 3990
query73 761 355 355 355
query74 10258 9145 8967 8967
query75 3332 2672 2669 2669
query76 2307 998 1092 998
query77 395 288 275 275
query78 10494 9565 9463 9463
query79 1300 593 596 593
query80 1211 460 429 429
query81 521 217 216 216
query82 1185 91 90 90
query83 239 146 145 145
query84 237 79 81 79
query85 1147 314 310 310
query86 336 298 303 298
query87 4391 4252 4309 4252
query88 3872 2514 2381 2381
query89 400 298 296 296
query90 1713 190 189 189
query91 140 108 110 108
query92 61 52 56 52
query93 1096 565 569 565
query94 689 300 300 300
query95 319 260 259 259
query96 614 293 288 288
query97 3310 3139 3112 3112
query98 218 204 191 191
query99 1503 1285 1310 1285
Total cold run time: 288337 ms
Total hot run time: 190205 ms
ClickBench: Total hot run time: 30.05 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d61f5d4b662923462dc8062890163e8a66ec2837, data reload: false
query1 0.03 0.03 0.03
query2 0.07 0.03 0.03
query3 0.24 0.07 0.06
query4 1.63 0.10 0.10
query5 0.52 0.54 0.51
query6 1.14 0.73 0.74
query7 0.02 0.02 0.02
query8 0.04 0.03 0.04
query9 0.56 0.51 0.51
query10 0.56 0.54 0.58
query11 0.14 0.10 0.12
query12 0.14 0.12 0.11
query13 0.62 0.60 0.59
query14 0.77 0.80 0.80
query15 0.83 0.82 0.84
query16 0.40 0.37 0.40
query17 1.07 1.10 1.03
query18 0.23 0.22 0.22
query19 1.85 1.84 1.77
query20 0.01 0.00 0.01
query21 15.39 0.61 0.59
query22 2.20 1.82 2.29
query23 16.99 0.94 0.94
query24 3.10 0.87 1.42
query25 0.18 0.05 0.05
query26 0.52 0.13 0.13
query27 0.06 0.04 0.05
query28 10.32 0.50 0.44
query29 12.61 3.22 3.19
query30 0.25 0.06 0.06
query31 2.86 0.38 0.38
query32 3.29 0.47 0.46
query33 3.01 2.97 2.98
query34 17.04 4.48 4.44
query35 4.55 4.51 4.58
query36 0.63 0.49 0.48
query37 0.09 0.06 0.06
query38 0.04 0.03 0.03
query39 0.03 0.02 0.03
query40 0.17 0.13 0.13
query41 0.07 0.03 0.02
query42 0.04 0.02 0.02
query43 0.03 0.03 0.03
Total cold run time: 104.34 s
Total hot run time: 30.05 s