doris
doris copied to clipboard
Published
20 hours ago •
apache
apache
[improvement](mtmv) Materialization context and mtmv decoupling
Proposed changes
draft optmize code for sync materilaized view
Further comments
If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.
PR approved by at least one committer and no changes requested.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
TPC-DS: Total hot run time: 186421 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 66e52e59d3badc87f9134c48c84a1f58f0fe18c9, data reload: false
query1 908 359 354 354
query2 6150 2456 2381 2381
query3 6655 205 206 205
query4 23155 21868 21941 21868
query5 3767 424 422 422
query6 271 180 167 167
query7 4672 290 293 290
query8 258 195 190 190
query9 8374 2416 2390 2390
query10 418 259 252 252
query11 15286 14695 14859 14695
query12 130 85 89 85
query13 1740 373 371 371
query14 10688 8386 6683 6683
query15 240 169 173 169
query16 8244 263 254 254
query17 1790 575 556 556
query18 2098 284 275 275
query19 329 153 155 153
query20 96 89 85 85
query21 195 141 127 127
query22 5007 4781 4771 4771
query23 34031 33192 33187 33187
query24 10570 2924 2894 2894
query25 632 370 369 369
query26 1134 158 153 153
query27 2349 330 326 326
query28 7242 2049 2039 2039
query29 892 627 682 627
query30 245 160 148 148
query31 946 739 741 739
query32 94 50 52 50
query33 733 246 240 240
query34 1060 488 484 484
query35 823 681 660 660
query36 1069 939 896 896
query37 133 67 65 65
query38 3116 2993 3011 2993
query39 1585 1568 1517 1517
query40 192 123 121 121
query41 40 37 37 37
query42 101 96 97 96
query43 567 554 556 554
query44 1176 726 736 726
query45 270 246 248 246
query46 1081 718 707 707
query47 1964 1830 1860 1830
query48 375 293 296 293
query49 1016 393 409 393
query50 776 384 396 384
query51 6716 6646 6636 6636
query52 103 89 92 89
query53 355 287 283 283
query54 333 231 236 231
query55 79 74 72 72
query56 235 217 216 216
query57 1251 1107 1128 1107
query58 238 205 205 205
query59 3465 3126 3173 3126
query60 247 230 233 230
query61 87 87 86 86
query62 651 443 443 443
query63 310 278 285 278
query64 8642 7287 7204 7204
query65 3108 3062 3071 3062
query66 812 365 335 335
query67 15558 15000 15025 15000
query68 8256 541 562 541
query69 544 310 317 310
query70 1221 1150 1142 1142
query71 529 288 274 274
query72 8101 2555 2383 2383
query73 738 316 321 316
query74 6504 6155 6033 6033
query75 4965 2645 2634 2634
query76 5199 1064 979 979
query77 762 272 272 272
query78 11091 10201 10030 10030
query79 9980 528 515 515
query80 1677 438 444 438
query81 490 223 219 219
query82 834 92 90 90
query83 197 165 160 160
query84 263 85 83 83
query85 1432 266 285 266
query86 469 287 306 287
query87 3274 3083 3069 3069
query88 5165 2322 2320 2320
query89 551 374 373 373
query90 2002 185 185 185
query91 129 96 100 96
query92 59 51 48 48
query93 7603 506 506 506
query94 1304 181 183 181
query95 391 312 308 308
query96 611 273 268 268
query97 3119 2908 2942 2908
query98 230 224 211 211
query99 1245 863 856 856
Total cold run time: 305808 ms
Total hot run time: 186421 ms
PR approved by at least one committer and no changes requested.
TPC-H: Total hot run time: 40545 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4b9630fc46d275a1f38d76c192996a03c11fdef8, data reload: false
------ Round 1 ----------------------------------
q1 17600 4365 4269 4269
q2 2022 194 187 187
q3 10461 1232 1249 1232
q4 10175 772 660 660
q5 7472 2650 2647 2647
q6 220 133 132 132
q7 984 583 577 577
q8 9232 2068 2039 2039
q9 8908 6567 6528 6528
q10 8907 3786 3732 3732
q11 451 245 240 240
q12 521 223 209 209
q13 17757 2967 2977 2967
q14 267 213 218 213
q15 505 481 463 463
q16 515 390 375 375
q17 961 670 818 670
q18 8067 7503 7344 7344
q19 8648 1528 1523 1523
q20 684 312 300 300
q21 5027 3962 4001 3962
q22 349 276 282 276
Total cold run time: 119733 ms
Total hot run time: 40545 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4331 4203 4169 4169
q2 366 272 270 270
q3 2985 2735 2751 2735
q4 1859 1549 1594 1549
q5 5284 5254 5277 5254
q6 209 121 124 121
q7 2191 1834 1868 1834
q8 3218 3347 3319 3319
q9 8351 8333 8331 8331
q10 3900 3740 3637 3637
q11 572 493 484 484
q12 766 574 593 574
q13 16370 2981 2923 2923
q14 296 267 259 259
q15 529 459 483 459
q16 457 403 418 403
q17 1762 1490 1487 1487
q18 7706 7590 7387 7387
q19 1640 1561 1612 1561
q20 1979 1754 1767 1754
q21 4989 4839 4970 4839
q22 580 507 509 507
Total cold run time: 70340 ms
Total hot run time: 53856 ms
TPC-DS: Total hot run time: 187258 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4b9630fc46d275a1f38d76c192996a03c11fdef8, data reload: false
query1 910 386 360 360
query2 6465 2422 2303 2303
query3 6662 206 205 205
query4 23282 21193 21405 21193
query5 4205 407 413 407
query6 255 199 176 176
query7 4597 294 287 287
query8 246 194 187 187
query9 8570 2393 2375 2375
query10 443 241 252 241
query11 14731 14182 14185 14182
query12 135 102 85 85
query13 1626 372 366 366
query14 9772 7587 8426 7587
query15 258 172 170 170
query16 8186 269 259 259
query17 1864 558 548 548
query18 2095 272 268 268
query19 267 145 141 141
query20 90 83 83 83
query21 193 129 132 129
query22 5042 4811 4888 4811
query23 34310 33658 33762 33658
query24 11080 2911 2792 2792
query25 612 362 366 362
query26 1513 153 148 148
query27 2969 326 314 314
query28 7331 2053 2038 2038
query29 924 610 598 598
query30 275 150 154 150
query31 965 757 746 746
query32 91 53 54 53
query33 763 249 248 248
query34 1014 468 486 468
query35 824 681 654 654
query36 1089 898 924 898
query37 140 63 66 63
query38 2883 2754 2755 2754
query39 1617 1576 1550 1550
query40 260 124 122 122
query41 42 38 40 38
query42 103 95 95 95
query43 593 540 551 540
query44 1259 712 725 712
query45 268 251 248 248
query46 1069 702 711 702
query47 1979 1892 1945 1892
query48 367 297 308 297
query49 1134 415 407 407
query50 792 386 384 384
query51 6874 6728 6780 6728
query52 101 86 94 86
query53 352 279 275 275
query54 833 429 436 429
query55 73 74 70 70
query56 239 224 223 223
query57 1224 1185 1175 1175
query58 233 203 203 203
query59 3543 3310 3224 3224
query60 251 239 237 237
query61 92 88 86 86
query62 667 463 464 463
query63 309 281 284 281
query64 9287 7331 7331 7331
query65 3120 3096 3118 3096
query66 1406 344 338 338
query67 15391 15050 15273 15050
query68 4719 558 536 536
query69 475 296 295 295
query70 1197 1137 1135 1135
query71 399 272 274 272
query72 8059 2634 2339 2339
query73 705 324 321 321
query74 6499 6254 6167 6167
query75 3310 2633 2592 2592
query76 2494 995 997 995
query77 427 256 266 256
query78 11157 10223 10175 10175
query79 2151 510 523 510
query80 1689 458 432 432
query81 517 219 216 216
query82 646 92 150 92
query83 259 163 161 161
query84 268 88 87 87
query85 1949 271 267 267
query86 491 301 311 301
query87 3247 3120 3116 3116
query88 4065 2407 2394 2394
query89 473 388 377 377
query90 1948 190 182 182
query91 126 115 99 99
query92 63 46 47 46
query93 2259 515 499 499
query94 1261 181 185 181
query95 403 303 314 303
query96 587 271 263 263
query97 3156 2973 3002 2973
query98 247 225 217 217
query99 1283 879 870 870
Total cold run time: 286684 ms
Total hot run time: 187258 ms