doris
doris copied to clipboard
Published
20 hours ago •
apache
apache
[fix](nereids)collect all correlated slots from subquery in correct way
Proposed changes
pick from master https://github.com/apache/doris/pull/30908
Further comments
If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
TPC-H: Total hot run time: 49878 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 995222003f51baa0b9dd3168a682ca1ea6965e31, data reload: false
------ Round 1 ----------------------------------
q1 17651 4370 4312 4312
q2 2046 151 145 145
q3 10348 1874 1957 1874
q4 10094 1219 1310 1219
q5 8477 3928 3991 3928
q6 235 120 124 120
q7 2037 1593 1583 1583
q8 9251 2697 2706 2697
q9 10824 10607 10509 10509
q10 8652 3539 3577 3539
q11 423 241 242 241
q12 460 298 301 298
q13 18379 3958 4055 3958
q14 361 329 317 317
q15 506 462 448 448
q16 695 594 593 593
q17 1132 971 941 941
q18 7327 6949 6795 6795
q19 1665 1576 1545 1545
q20 542 318 321 318
q21 4479 4096 4121 4096
q22 513 407 402 402
Total cold run time: 116097 ms
Total hot run time: 49878 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4354 4262 4298 4262
q2 320 223 222 222
q3 4166 4170 4127 4127
q4 2737 2744 2734 2734
q5 7333 7169 7191 7169
q6 232 118 118 118
q7 3274 2924 2825 2825
q8 4370 4482 4519 4482
q9 17058 16972 17045 16972
q10 4218 4249 4287 4249
q11 756 689 667 667
q12 1024 860 845 845
q13 6918 3750 3742 3742
q14 446 423 416 416
q15 492 464 457 457
q16 782 710 711 710
q17 3800 3861 3820 3820
q18 8822 8747 8815 8747
q19 1695 1712 1670 1670
q20 2378 2163 2117 2117
q21 8495 8522 8418 8418
q22 1072 929 932 929
Total cold run time: 84742 ms
Total hot run time: 79698 ms
TPC-DS: Total hot run time: 202666 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 995222003f51baa0b9dd3168a682ca1ea6965e31, data reload: false
query1 919 387 380 380
query2 6537 2161 2241 2161
query3 6915 205 201 201
query4 20656 18149 18010 18010
query5 19719 6493 6491 6491
query6 268 211 222 211
query7 4143 297 299 297
query8 264 233 223 223
query9 3094 2694 2621 2621
query10 409 283 287 283
query11 11336 10756 10774 10756
query12 124 80 73 73
query13 5570 644 623 623
query14 17466 13618 13536 13536
query15 390 246 245 245
query16 6461 266 260 260
query17 1730 1463 876 876
query18 2316 411 403 403
query19 197 142 149 142
query20 76 76 80 76
query21 186 96 96 96
query22 5384 5188 5228 5188
query23 32590 32188 31952 31952
query24 7010 6505 6441 6441
query25 503 442 420 420
query26 524 159 158 158
query27 1902 297 288 288
query28 6023 2214 2198 2198
query29 2926 2882 2828 2828
query30 240 162 157 157
query31 896 710 738 710
query32 61 58 53 53
query33 395 248 243 243
query34 847 481 473 473
query35 1108 858 945 858
query36 1477 1580 1664 1580
query37 84 65 58 58
query38 3129 2924 2924 2924
query39 1356 1301 1331 1301
query40 199 94 91 91
query41 36 31 31 31
query42 91 76 86 76
query43 664 655 695 655
query44 1115 704 705 704
query45 234 229 224 224
query46 1232 981 982 981
query47 2007 1673 1744 1673
query48 971 676 670 670
query49 610 367 359 359
query50 845 603 591 591
query51 4756 4618 4640 4618
query52 86 76 73 73
query53 448 319 318 318
query54 2636 2482 2451 2451
query55 94 82 85 82
query56 199 205 206 205
query57 1147 1065 1209 1065
query58 211 210 205 205
query59 3474 3402 3273 3273
query60 211 180 201 180
query61 82 84 78 78
query62 853 455 481 455
query63 465 350 339 339
query64 2526 1458 1284 1284
query65 3645 3538 3563 3538
query66 798 353 370 353
query67 16543 15077 15196 15077
query68 8556 641 647 641
query69 549 350 336 336
query70 1885 1855 1701 1701
query71 387 305 310 305
query72 6466 3459 3455 3455
query73 724 314 320 314
query74 6346 5925 5882 5882
query75 4869 3752 3696 3696
query76 4982 1176 1222 1176
query77 723 249 251 249
query78 12910 12374 11902 11902
query79 9973 644 626 626
query80 800 380 389 380
query81 500 230 222 222
query82 1127 95 98 95
query83 159 139 125 125
query84 262 70 68 68
query85 809 278 275 275
query86 379 379 401 379
query87 3169 2982 2955 2955
query88 4988 2304 2286 2286
query89 422 295 271 271
query90 1915 202 210 202
query91 148 112 116 112
query92 53 50 51 50
query93 5808 572 557 557
query94 695 192 202 192
query95 1095 1056 1051 1051
query96 645 319 316 316
query97 6482 6361 6457 6361
query98 168 176 174 174
query99 2714 939 869 869
Total cold run time: 312117 ms
Total hot run time: 202666 ms
ClickBench: Total hot run time: 31.01 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 995222003f51baa0b9dd3168a682ca1ea6965e31, data reload: false
query1 0.02 0.03 0.02
query2 0.06 0.02 0.02
query3 0.24 0.06 0.06
query4 1.81 0.06 0.06
query5 0.53 0.53 0.52
query6 1.26 0.63 0.62
query7 0.01 0.01 0.01
query8 0.03 0.02 0.02
query9 0.53 0.47 0.48
query10 0.54 0.55 0.53
query11 0.12 0.09 0.09
query12 0.12 0.10 0.10
query13 0.61 0.61 0.61
query14 0.79 0.80 0.79
query15 0.78 0.76 0.78
query16 0.36 0.39 0.37
query17 1.03 0.99 1.02
query18 0.20 0.27 0.26
query19 1.94 1.88 1.86
query20 0.01 0.00 0.01
query21 15.47 0.56 0.55
query22 1.98 2.57 1.17
query23 17.26 0.92 0.88
query24 6.62 1.58 1.55
query25 1.55 0.12 0.12
query26 0.34 0.16 0.14
query27 0.10 0.11 0.10
query28 6.40 0.74 0.74
query29 12.80 2.33 2.31
query30 0.58 0.52 0.54
query31 2.80 0.37 0.39
query32 3.41 0.49 0.49
query33 3.06 3.06 3.04
query34 15.24 4.79 4.77
query35 4.89 4.85 4.83
query36 1.06 1.00 1.02
query37 0.05 0.05 0.04
query38 0.03 0.02 0.02
query39 0.01 0.02 0.02
query40 0.16 0.14 0.14
query41 0.06 0.02 0.02
query42 0.02 0.01 0.01
query43 0.02 0.02 0.02
Total cold run time: 104.9 s
Total hot run time: 31.01 s
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 995222003f51baa0b9dd3168a682ca1ea6965e31 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.3 seconds inserted 10000000 Rows, about 469K ops/s