doris
doris copied to clipboard
Published
20 hours ago •
apache
apache
[fix](partial update) only unique table with MOW insert with target columns can consider be a partial update
Proposed changes
cherry pick from #33656
Further comments
If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.
TPC-H: Total hot run time: 49708 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 09c0f505c361ad745dc9be192351ad167a74edf1, data reload: false
------ Round 1 ----------------------------------
q1 17725 4352 4357 4352
q2 2025 156 142 142
q3 10353 1899 1947 1899
q4 10095 1228 1320 1228
q5 8466 3910 3909 3909
q6 224 121 124 121
q7 2090 1622 1642 1622
q8 9283 2712 2728 2712
q9 10602 10359 10151 10151
q10 8661 3526 3486 3486
q11 428 235 246 235
q12 475 305 302 302
q13 18337 3995 3982 3982
q14 352 322 335 322
q15 503 452 459 452
q16 703 586 577 577
q17 1129 985 959 959
q18 7397 6954 6948 6948
q19 1715 1626 1555 1555
q20 523 333 297 297
q21 4474 4159 4057 4057
q22 506 400 401 400
Total cold run time: 116066 ms
Total hot run time: 49708 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4314 4279 4273 4273
q2 322 226 218 218
q3 4177 4156 4157 4156
q4 2764 2741 2742 2741
q5 7105 7084 7076 7076
q6 234 118 119 118
q7 3227 2794 2884 2794
q8 4389 4488 4491 4488
q9 16882 16731 16701 16701
q10 4213 4250 4277 4250
q11 757 653 666 653
q12 1002 876 864 864
q13 6753 3758 3734 3734
q14 459 426 427 426
q15 495 456 454 454
q16 725 682 674 674
q17 3805 3908 3862 3862
q18 8785 8733 8706 8706
q19 1727 1710 1649 1649
q20 2446 2146 2103 2103
q21 8529 8472 8469 8469
q22 1005 956 957 956
Total cold run time: 84115 ms
Total hot run time: 79365 ms
TPC-DS: Total hot run time: 202581 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 09c0f505c361ad745dc9be192351ad167a74edf1, data reload: false
query1 907 390 376 376
query2 6544 2754 2365 2365
query3 6915 198 194 194
query4 20291 17889 18013 17889
query5 19729 6492 6562 6492
query6 316 213 232 213
query7 4296 305 299 299
query8 256 241 229 229
query9 3224 2753 2690 2690
query10 421 292 302 292
query11 11504 10846 10762 10762
query12 122 82 74 74
query13 5604 696 677 677
query14 18057 13566 13155 13155
query15 362 218 229 218
query16 6440 274 254 254
query17 1715 1443 855 855
query18 2328 403 397 397
query19 200 153 149 149
query20 80 72 75 72
query21 186 87 95 87
query22 5242 5063 5056 5056
query23 32524 31885 31790 31790
query24 6756 6519 6541 6519
query25 508 421 428 421
query26 521 159 154 154
query27 1888 289 288 288
query28 6296 2426 2389 2389
query29 2971 2767 2632 2632
query30 238 164 164 164
query31 918 720 724 720
query32 68 60 54 54
query33 394 254 254 254
query34 833 462 473 462
query35 1114 895 945 895
query36 1268 1233 1218 1218
query37 89 62 58 58
query38 3057 2939 2929 2929
query39 1373 1329 1310 1310
query40 205 91 94 91
query41 40 34 34 34
query42 84 80 83 80
query43 778 668 727 668
query44 1210 730 728 728
query45 238 230 231 230
query46 1220 990 948 948
query47 1962 1737 1625 1625
query48 1016 720 701 701
query49 617 362 392 362
query50 876 612 635 612
query51 4734 4616 4610 4610
query52 106 77 82 77
query53 438 325 316 316
query54 2644 2445 2434 2434
query55 82 82 76 76
query56 230 198 196 196
query57 1179 1061 1057 1057
query58 221 208 210 208
query59 3973 3997 3996 3996
query60 196 184 201 184
query61 89 82 83 82
query62 842 440 523 440
query63 460 335 334 334
query64 2345 1507 1491 1491
query65 3610 3538 3548 3538
query66 783 363 379 363
query67 15386 15972 15687 15687
query68 9412 670 678 670
query69 565 325 345 325
query70 1565 1759 1291 1291
query71 419 300 307 300
query72 6505 3476 3412 3412
query73 734 329 323 323
query74 6349 5873 5839 5839
query75 5306 3758 3713 3713
query76 5784 1134 1224 1134
query77 972 253 245 245
query78 12659 11605 11711 11605
query79 7152 626 638 626
query80 964 398 390 390
query81 496 231 231 231
query82 1558 96 94 94
query83 167 131 137 131
query84 263 68 65 65
query85 864 297 296 296
query86 328 299 302 299
query87 3261 3057 3008 3008
query88 4912 2305 2308 2305
query89 378 279 287 279
query90 1931 191 201 191
query91 163 132 134 132
query92 57 49 49 49
query93 4992 564 532 532
query94 676 203 197 197
query95 1127 1064 1066 1064
query96 622 325 326 325
query97 6488 6348 6245 6245
query98 205 179 164 164
query99 3030 881 903 881
Total cold run time: 311023 ms
Total hot run time: 202581 ms
ClickBench: Total hot run time: 31.36 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 09c0f505c361ad745dc9be192351ad167a74edf1, data reload: false
query1 0.03 0.03 0.02
query2 0.07 0.02 0.02
query3 0.24 0.05 0.04
query4 1.80 0.07 0.08
query5 0.53 0.53 0.52
query6 1.24 0.63 0.63
query7 0.02 0.01 0.01
query8 0.03 0.02 0.03
query9 0.52 0.49 0.48
query10 0.54 0.54 0.53
query11 0.11 0.09 0.08
query12 0.12 0.10 0.09
query13 0.62 0.62 0.62
query14 0.77 0.78 0.79
query15 0.78 0.75 0.76
query16 0.36 0.38 0.38
query17 1.01 1.02 1.02
query18 0.20 0.26 0.24
query19 1.89 1.90 1.87
query20 0.01 0.01 0.00
query21 15.49 0.55 0.54
query22 1.99 1.87 1.66
query23 17.38 0.95 0.96
query24 4.31 1.32 1.46
query25 0.33 0.07 0.08
query26 0.55 0.17 0.15
query27 0.04 0.05 0.04
query28 8.53 0.72 0.74
query29 12.70 2.34 2.35
query30 0.56 0.53 0.53
query31 2.81 0.38 0.37
query32 3.37 0.50 0.49
query33 3.07 3.12 3.10
query34 15.28 4.80 4.79
query35 4.88 4.85 4.86
query36 1.06 1.01 1.02
query37 0.06 0.04 0.05
query38 0.03 0.02 0.02
query39 0.02 0.01 0.01
query40 0.16 0.14 0.14
query41 0.06 0.02 0.02
query42 0.02 0.02 0.02
query43 0.02 0.02 0.01
Total cold run time: 103.61 s
Total hot run time: 31.36 s
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 09c0f505c361ad745dc9be192351ad167a74edf1 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.1 seconds inserted 10000000 Rows, about 473K ops/s
PR approved by at least one committer and no changes requested.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}