doris
doris copied to clipboard
apache
[draft] lazy create column writer when flush memtable for partial update
What problem does this PR solve?
Release note
None
Check List (For Author)
-
Test
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
-
Behavior changed:
- [ ] No.
- [ ] Yes.
-
Does this need documentation?
- [ ] No.
- [ ] Yes.
Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
- What problem was fixed (it's best to include specific error reporting information). How it was fixed.
- Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
- What features were added. Why was this function added?
- Which code was refactored and why was this part of the code refactored?
- Which functions were optimized and what is the difference before and after the optimization?
TPC-H: Total hot run time: 35253 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 52b8b3486f56c2bccbeec3c5fd4d954f721c7705, data reload: false
------ Round 1 ----------------------------------
q1 17632 4210 4127 4127
q2 2016 347 233 233
q3 10203 1283 783 783
q4 10219 895 326 326
q5 7539 2157 1937 1937
q6 183 169 136 136
q7 1020 875 714 714
q8 9358 1465 1164 1164
q9 7177 5314 5324 5314
q10 6859 2382 1956 1956
q11 537 329 283 283
q12 730 737 561 561
q13 17772 3723 3033 3033
q14 288 303 268 268
q15 607 521 511 511
q16 947 923 876 876
q17 728 825 509 509
q18 7579 7096 7029 7029
q19 1100 976 631 631
q20 391 361 254 254
q21 4294 3938 3632 3632
q22 1061 987 976 976
Total cold run time: 108240 ms
Total hot run time: 35253 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4085 4078 4080 4078
q2 340 425 340 340
q3 2121 2689 2350 2350
q4 1308 1785 1335 1335
q5 4281 4762 4675 4675
q6 218 196 147 147
q7 2152 2031 1799 1799
q8 2730 2512 2518 2512
q9 7560 7630 7504 7504
q10 3117 3277 2837 2837
q11 607 518 583 518
q12 762 788 592 592
q13 3510 4102 3437 3437
q14 278 322 281 281
q15 600 506 520 506
q16 928 922 895 895
q17 1179 1398 1478 1398
q18 8060 7455 7648 7455
q19 915 902 931 902
q20 2082 2048 1785 1785
q21 4699 4332 4345 4332
q22 1073 1010 977 977
Total cold run time: 52605 ms
Total hot run time: 50655 ms
TPC-DS: Total hot run time: 181190 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 52b8b3486f56c2bccbeec3c5fd4d954f721c7705, data reload: false
query5 5017 619 464 464
query6 326 224 214 214
query7 4224 458 275 275
query8 305 248 236 236
query9 8772 2564 2576 2564
query10 536 368 326 326
query11 15612 14736 14804 14736
query12 179 113 109 109
query13 1244 502 392 392
query14 6165 3177 2963 2963
query14_1 2874 2809 2806 2806
query15 209 195 177 177
query16 785 467 453 453
query17 1113 691 594 594
query18 2487 429 333 333
query19 228 216 199 199
query20 124 110 106 106
query21 220 138 115 115
query22 3947 3961 3943 3943
query23 16571 16167 16067 16067
query23_1 16032 16094 16027 16027
query24 7372 1756 1199 1199
query24_1 1235 1237 1262 1237
query25 558 474 412 412
query26 1248 269 162 162
query27 2762 469 313 313
query28 4482 2147 2141 2141
query29 784 538 438 438
query30 326 234 208 208
query31 813 706 610 610
query32 76 68 67 67
query33 543 332 281 281
query34 904 920 540 540
query35 774 807 752 752
query36 885 916 847 847
query37 138 94 76 76
query38 3881 3831 3773 3773
query39 747 736 709 709
query39_1 696 691 700 691
query40 223 139 121 121
query41 67 64 61 61
query42 110 105 106 105
query43 428 439 401 401
query44 1332 750 751 750
query45 196 192 194 192
query46 891 972 629 629
query47 1678 1709 1605 1605
query48 308 324 245 245
query49 642 426 351 351
query50 659 301 219 219
query51 3781 3796 3788 3788
query52 105 114 103 103
query53 319 348 295 295
query54 286 268 262 262
query55 83 78 68 68
query56 289 288 299 288
query57 1173 1137 1093 1093
query58 270 254 257 254
query59 2385 2513 2388 2388
query60 322 324 295 295
query61 173 165 174 165
query62 698 955 845 845
query63 361 326 313 313
query64 5072 1438 1110 1110
query65 4003 3926 3965 3926
query66 1536 485 315 315
query67 14946 14736 14761 14736
query68 3407 1065 754 754
query69 487 353 308 308
query70 1040 1008 996 996
query71 366 308 282 282
query72 6105 4855 4866 4855
query73 666 567 316 316
query74 8911 8739 8566 8566
query75 3545 3525 3159 3159
query76 3779 1133 744 744
query77 525 387 290 290
query78 9419 9811 8938 8938
query79 1020 880 611 611
query80 697 665 549 549
query81 507 267 232 232
query82 219 129 104 104
query83 271 268 236 236
query84 250 124 104 104
query85 867 524 449 449
query86 311 307 303 303
query87 4087 3961 3976 3961
query88 3144 2304 2274 2274
query89 471 448 386 386
query90 1986 151 156 151
query91 181 184 147 147
query92 70 68 64 64
query93 971 886 565 565
query94 363 311 280 280
query95 581 329 329 329
query96 600 459 214 214
query97 2590 2678 2600 2600
query98 213 196 204 196
query99 1293 1302 1252 1252
Total cold run time: 256955 ms
Total hot run time: 181190 ms
ClickBench: Total hot run time: 27.28 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 52b8b3486f56c2bccbeec3c5fd4d954f721c7705, data reload: false
query1 0.05 0.05 0.05
query2 0.11 0.05 0.04
query3 0.25 0.08 0.08
query4 1.60 0.11 0.10
query5 0.27 0.25 0.26
query6 1.16 0.62 0.63
query7 0.03 0.02 0.02
query8 0.06 0.04 0.05
query9 0.58 0.51 0.51
query10 0.54 0.54 0.56
query11 0.16 0.11 0.11
query12 0.14 0.11 0.12
query13 0.62 0.60 0.60
query14 1.00 0.98 0.97
query15 0.82 0.79 0.79
query16 0.42 0.42 0.42
query17 1.01 1.07 1.05
query18 0.23 0.21 0.20
query19 1.85 1.85 1.82
query20 0.02 0.02 0.01
query21 15.49 0.26 0.14
query22 4.92 0.06 0.05
query23 16.16 0.27 0.10
query24 2.05 0.54 0.28
query25 0.07 0.08 0.08
query26 0.14 0.14 0.13
query27 0.07 0.05 0.05
query28 4.10 1.22 1.03
query29 12.59 4.01 3.19
query30 0.28 0.13 0.12
query31 2.83 0.64 0.38
query32 3.23 0.55 0.46
query33 2.97 2.97 3.07
query34 16.85 5.18 4.56
query35 4.53 4.61 4.56
query36 0.67 0.49 0.49
query37 0.10 0.06 0.06
query38 0.07 0.04 0.04
query39 0.05 0.03 0.03
query40 0.17 0.14 0.15
query41 0.09 0.03 0.03
query42 0.05 0.03 0.03
query43 0.04 0.04 0.03
Total cold run time: 98.44 s
Total hot run time: 27.28 s
TPC-H: Total hot run time: 35224 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c8f180e8e6ca43bc876fe288e904bca90045ae94, data reload: false
------ Round 1 ----------------------------------
q1 17638 4321 4104 4104
q2 2118 353 242 242
q3 10130 1356 748 748
q4 10225 873 331 331
q5 7562 2064 2014 2014
q6 187 174 140 140
q7 1005 851 709 709
q8 9374 1404 1220 1220
q9 7022 5288 5265 5265
q10 6787 2395 1978 1978
q11 510 315 315 315
q12 650 762 575 575
q13 17763 3673 3029 3029
q14 289 300 271 271
q15 574 525 507 507
q16 666 672 632 632
q17 699 779 557 557
q18 7530 7129 7004 7004
q19 1116 959 602 602
q20 397 354 251 251
q21 4205 3832 3768 3768
q22 1043 991 962 962
Total cold run time: 107490 ms
Total hot run time: 35224 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4161 4089 4066 4066
q2 341 397 321 321
q3 2174 2660 2326 2326
q4 1303 1744 1353 1353
q5 4268 4566 4926 4566
q6 230 176 134 134
q7 2070 1991 1832 1832
q8 2661 2549 2632 2549
q9 7713 7625 7555 7555
q10 3033 3234 2886 2886
q11 582 508 491 491
q12 715 937 616 616
q13 3486 3792 3339 3339
q14 297 294 322 294
q15 593 515 521 515
q16 669 671 622 622
q17 1283 1499 1413 1413
q18 8115 7559 7564 7559
q19 867 891 903 891
q20 1994 2139 1947 1947
q21 4931 4683 4185 4185
q22 1083 1015 952 952
Total cold run time: 52569 ms
Total hot run time: 50412 ms
TPC-DS: Total hot run time: 178728 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c8f180e8e6ca43bc876fe288e904bca90045ae94, data reload: false
query5 4583 599 468 468
query6 338 233 229 229
query7 4235 473 278 278
query8 304 259 259 259
query9 8805 2556 2577 2556
query10 521 367 331 331
query11 15117 14813 14893 14813
query12 184 128 119 119
query13 1273 509 408 408
query14 6411 3551 2940 2940
query14_1 2832 2832 2858 2832
query15 213 193 177 177
query16 940 517 415 415
query17 1102 700 568 568
query18 2565 436 332 332
query19 223 234 205 205
query20 122 115 109 109
query21 215 144 111 111
query22 3869 3958 3869 3869
query23 16498 16214 15862 15862
query23_1 15988 16059 16028 16028
query24 7319 1644 1246 1246
query24_1 1222 1213 1248 1213
query25 536 464 401 401
query26 1246 279 174 174
query27 2745 469 303 303
query28 4476 2159 2148 2148
query29 836 587 478 478
query30 313 242 214 214
query31 822 719 628 628
query32 86 70 72 70
query33 555 347 298 298
query34 909 925 544 544
query35 818 826 743 743
query36 862 906 831 831
query37 135 96 77 77
query38 2874 2941 2869 2869
query39 744 738 735 735
query39_1 753 702 702 702
query40 226 144 126 126
query41 82 68 69 68
query42 107 107 106 106
query43 427 434 422 422
query44 1327 752 755 752
query45 197 196 188 188
query46 885 987 626 626
query47 1649 1659 1630 1630
query48 332 331 257 257
query49 644 445 379 379
query50 654 298 221 221
query51 3905 3961 3785 3785
query52 110 109 99 99
query53 335 354 292 292
query54 300 281 280 280
query55 84 73 74 73
query56 308 324 315 315
query57 1133 1147 1080 1080
query58 286 265 256 256
query59 2464 2507 2394 2394
query60 322 322 313 313
query61 196 191 193 191
query62 713 710 619 619
query63 326 292 303 292
query64 4989 1293 997 997
query65 4020 3952 3942 3942
query66 1414 442 309 309
query67 15188 15106 14955 14955
query68 8256 1008 719 719
query69 484 353 318 318
query70 1068 1002 990 990
query71 388 307 286 286
query72 6320 4996 5030 4996
query73 683 602 311 311
query74 8785 9235 8713 8713
query75 3185 3092 2775 2775
query76 3968 1139 746 746
query77 585 392 282 282
query78 9408 9573 8841 8841
query79 1665 838 623 623
query80 713 658 549 549
query81 519 269 242 242
query82 337 137 108 108
query83 264 261 248 248
query84 261 124 102 102
query85 1016 530 471 471
query86 385 296 280 280
query87 2993 3017 2907 2907
query88 4340 2288 2309 2288
query89 479 422 388 388
query90 2159 153 149 149
query91 175 170 141 141
query92 82 67 65 65
query93 1641 921 566 566
query94 493 310 280 280
query95 568 368 313 313
query96 588 480 211 211
query97 2270 2291 2223 2223
query98 214 193 193 193
query99 1347 1345 1237 1237
Total cold run time: 261419 ms
Total hot run time: 178728 ms
ClickBench: Total hot run time: 27.67 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c8f180e8e6ca43bc876fe288e904bca90045ae94, data reload: false
query1 0.06 0.05 0.05
query2 0.10 0.04 0.04
query3 0.26 0.09 0.09
query4 1.60 0.11 0.12
query5 0.28 0.26 0.28
query6 1.15 0.64 0.63
query7 0.03 0.03 0.03
query8 0.05 0.04 0.04
query9 0.58 0.52 0.51
query10 0.55 0.54 0.56
query11 0.16 0.10 0.11
query12 0.14 0.12 0.12
query13 0.61 0.59 0.60
query14 1.00 0.98 0.97
query15 0.81 0.79 0.80
query16 0.42 0.38 0.40
query17 0.96 1.08 0.99
query18 0.23 0.21 0.22
query19 1.83 1.79 1.80
query20 0.02 0.01 0.01
query21 15.44 0.29 0.14
query22 4.75 0.05 0.04
query23 15.88 0.29 0.11
query24 1.42 0.67 1.44
query25 0.11 0.06 0.07
query26 0.15 0.13 0.14
query27 0.08 0.05 0.06
query28 6.16 1.21 1.02
query29 12.60 4.16 3.32
query30 0.29 0.14 0.13
query31 2.82 0.62 0.39
query32 3.24 0.55 0.46
query33 3.00 2.98 3.09
query34 16.83 5.22 4.55
query35 4.58 4.56 4.51
query36 0.66 0.49 0.49
query37 0.11 0.07 0.07
query38 0.06 0.04 0.04
query39 0.04 0.04 0.04
query40 0.16 0.13 0.14
query41 0.09 0.03 0.03
query42 0.04 0.03 0.03
query43 0.04 0.03 0.04
Total cold run time: 99.39 s
Total hot run time: 27.67 s
BE UT Coverage Report
Increment line coverage 0.00% (0/9) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 53.42% (18822/35237) |
| Line Coverage | 39.16% (174016/444404) |
| Region Coverage | 33.80% (134744/398656) |
| Branch Coverage | 34.74% (57993/166917) |
BE UT Coverage Report
Increment line coverage 0.00% (0/18) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 53.42% (18822/35236) |
| Line Coverage | 39.16% (174015/444382) |
| Region Coverage | 33.83% (134875/398631) |
| Branch Coverage | 34.75% (57991/166898) |
TPC-H: Total hot run time: 36190 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7ddf616c4c679f86cf99311a04f29d484fb0e4e0, data reload: false
------ Round 1 ----------------------------------
q1 17632 4228 4056 4056
q2 2073 356 250 250
q3 10186 1426 749 749
q4 10217 872 319 319
q5 7545 2134 1891 1891
q6 189 170 135 135
q7 994 866 701 701
q8 9363 1392 1187 1187
q9 7070 5302 5318 5302
q10 6778 2406 1952 1952
q11 514 321 291 291
q12 675 809 646 646
q13 17754 3656 3037 3037
q14 294 306 272 272
q15 608 510 505 505
q16 675 675 626 626
q17 697 813 522 522
q18 7464 7571 7908 7571
q19 1107 994 662 662
q20 435 376 253 253
q21 4499 4292 4229 4229
q22 1107 1034 1049 1034
Total cold run time: 107876 ms
Total hot run time: 36190 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4297 4262 4314 4262
q2 313 402 322 322
q3 2368 2911 2491 2491
q4 1453 1858 1487 1487
q5 4525 4611 4440 4440
q6 204 171 130 130
q7 2039 2013 1791 1791
q8 2652 2509 2520 2509
q9 7523 7461 7509 7461
q10 3043 3288 2800 2800
q11 570 499 463 463
q12 645 691 539 539
q13 3267 3608 3027 3027
q14 256 273 257 257
q15 540 490 491 490
q16 613 659 598 598
q17 1107 1301 1323 1301
q18 7349 7153 6947 6947
q19 833 794 841 794
q20 1878 1962 1798 1798
q21 4670 4322 4270 4270
q22 1103 1043 989 989
Total cold run time: 51248 ms
Total hot run time: 49166 ms
TPC-DS: Total hot run time: 177996 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7ddf616c4c679f86cf99311a04f29d484fb0e4e0, data reload: false
query5 5025 625 489 489
query6 349 243 242 242
query7 4231 475 278 278
query8 312 258 245 245
query9 8794 2524 2530 2524
query10 531 391 335 335
query11 15564 14901 14835 14835
query12 201 122 121 121
query13 1282 520 402 402
query14 7818 3253 3049 3049
query14_1 2904 2949 2933 2933
query15 266 200 183 183
query16 824 499 481 481
query17 1324 719 610 610
query18 2722 441 361 361
query19 314 238 220 220
query20 135 116 113 113
query21 218 141 120 120
query22 3898 3997 3872 3872
query23 16566 16284 15877 15877
query23_1 15899 16142 16100 16100
query24 6997 1666 1239 1239
query24_1 1279 1258 1261 1258
query25 588 518 467 467
query26 1282 271 160 160
query27 2701 469 301 301
query28 4405 2142 2132 2132
query29 805 556 437 437
query30 324 245 214 214
query31 819 713 604 604
query32 80 71 65 65
query33 533 354 283 283
query34 871 898 550 550
query35 783 791 712 712
query36 878 919 845 845
query37 136 99 93 93
query38 2855 2884 2871 2871
query39 759 749 732 732
query39_1 691 698 692 692
query40 232 141 123 123
query41 67 67 61 61
query42 106 109 103 103
query43 433 437 411 411
query44 1387 760 746 746
query45 194 196 185 185
query46 906 974 620 620
query47 1611 1701 1607 1607
query48 314 325 244 244
query49 642 439 370 370
query50 718 299 220 220
query51 3872 3881 3765 3765
query52 107 108 99 99
query53 324 360 292 292
query54 300 274 253 253
query55 78 77 69 69
query56 310 303 304 303
query57 1143 1130 1062 1062
query58 272 278 249 249
query59 2357 2426 2324 2324
query60 322 316 294 294
query61 161 158 160 158
query62 684 685 630 630
query63 327 294 306 294
query64 4967 1339 1007 1007
query65 4013 3940 3921 3921
query66 1386 465 320 320
query67 15333 14843 14737 14737
query68 5656 1010 730 730
query69 494 350 314 314
query70 1090 1013 982 982
query71 404 316 293 293
query72 6134 4909 5198 4909
query73 674 581 313 313
query74 8882 8915 8548 8548
query75 3152 3116 2765 2765
query76 3925 1150 763 763
query77 517 405 308 308
query78 9492 9553 8826 8826
query79 1770 896 641 641
query80 751 656 559 559
query81 533 270 243 243
query82 209 135 109 109
query83 267 258 247 247
query84 264 119 104 104
query85 902 510 464 464
query86 385 293 273 273
query87 3029 3033 3017 3017
query88 4093 2287 2235 2235
query89 469 424 397 397
query90 2216 155 162 155
query91 175 169 149 149
query92 85 66 66 66
query93 2393 926 563 563
query94 476 306 263 263
query95 578 336 311 311
query96 593 496 210 210
query97 2242 2271 2228 2228
query98 223 202 215 202
query99 1280 1305 1195 1195
Total cold run time: 262092 ms
Total hot run time: 177996 ms
ClickBench: Total hot run time: 27.31 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7ddf616c4c679f86cf99311a04f29d484fb0e4e0, data reload: false
query1 0.06 0.04 0.04
query2 0.11 0.05 0.05
query3 0.26 0.10 0.09
query4 1.61 0.11 0.11
query5 0.28 0.26 0.25
query6 1.18 0.64 0.62
query7 0.03 0.03 0.03
query8 0.06 0.04 0.05
query9 0.56 0.52 0.51
query10 0.56 0.54 0.55
query11 0.16 0.11 0.11
query12 0.15 0.12 0.11
query13 0.61 0.61 0.61
query14 0.98 0.99 0.98
query15 0.81 0.80 0.81
query16 0.42 0.40 0.42
query17 0.96 1.03 1.05
query18 0.23 0.22 0.22
query19 1.82 1.81 1.85
query20 0.02 0.01 0.01
query21 15.45 0.28 0.14
query22 4.87 0.05 0.05
query23 16.11 0.28 0.10
query24 0.97 0.56 0.29
query25 0.08 0.05 0.06
query26 0.14 0.12 0.13
query27 0.08 0.06 0.05
query28 3.33 1.21 1.04
query29 12.58 4.03 3.27
query30 0.27 0.14 0.13
query31 2.82 0.62 0.39
query32 3.23 0.55 0.46
query33 3.08 2.97 3.07
query34 16.72 5.16 4.49
query35 4.51 4.58 4.55
query36 0.66 0.50 0.50
query37 0.11 0.06 0.07
query38 0.08 0.04 0.04
query39 0.04 0.03 0.03
query40 0.16 0.15 0.14
query41 0.09 0.03 0.02
query42 0.04 0.04 0.03
query43 0.04 0.04 0.03
Total cold run time: 96.33 s
Total hot run time: 27.31 s
BE UT Coverage Report
Increment line coverage 26.92% (7/26) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 53.43% (18829/35243) |
| Line Coverage | 39.17% (174072/444455) |
| Region Coverage | 33.83% (134890/398737) |
| Branch Coverage | 34.76% (58016/166922) |
TPC-H: Total hot run time: 36433 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e4518bb504d12d9fe8b026a13acfe67f671c58eb, data reload: false
------ Round 1 ----------------------------------
q1 17622 4198 4054 4054
q2 2027 339 229 229
q3 10194 1307 724 724
q4 10220 895 317 317
q5 7551 2111 1916 1916
q6 184 166 138 138
q7 1001 850 709 709
q8 9381 1415 1168 1168
q9 7018 5341 5301 5301
q10 6830 2385 1976 1976
q11 526 326 311 311
q12 665 715 566 566
q13 17960 3726 3051 3051
q14 298 322 288 288
q15 605 533 512 512
q16 699 673 632 632
q17 712 840 527 527
q18 7916 7916 7943 7916
q19 2102 1042 621 621
q20 397 366 257 257
q21 4571 4275 4169 4169
q22 1126 1067 1051 1051
Total cold run time: 109605 ms
Total hot run time: 36433 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4311 4204 4289 4204
q2 327 413 318 318
q3 2530 2882 2546 2546
q4 1395 1853 1447 1447
q5 4552 4347 4464 4347
q6 218 174 131 131
q7 2281 1920 1775 1775
q8 2675 2631 2538 2538
q9 7543 7471 7255 7255
q10 2905 3073 2660 2660
q11 569 487 473 473
q12 624 699 563 563
q13 3238 3649 3032 3032
q14 273 276 254 254
q15 537 513 494 494
q16 613 675 602 602
q17 1100 1411 1330 1330
q18 7271 7075 7065 7065
q19 833 798 808 798
q20 1927 1995 1831 1831
q21 4625 4348 4160 4160
q22 1158 1078 990 990
Total cold run time: 51505 ms
Total hot run time: 48813 ms
TPC-DS: Total hot run time: 177598 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e4518bb504d12d9fe8b026a13acfe67f671c58eb, data reload: false
query5 5013 617 470 470
query6 327 232 216 216
query7 4222 457 274 274
query8 291 252 239 239
query9 8778 2565 2579 2565
query10 516 387 318 318
query11 15506 15190 14538 14538
query12 178 117 115 115
query13 1260 486 395 395
query14 6231 3211 2988 2988
query14_1 2920 2908 2870 2870
query15 220 198 180 180
query16 936 487 460 460
query17 1161 727 613 613
query18 2592 456 357 357
query19 249 229 212 212
query20 122 116 112 112
query21 221 134 121 121
query22 4040 3972 3810 3810
query23 16573 16032 15992 15992
query23_1 16090 15970 16126 15970
query24 7355 1668 1257 1257
query24_1 1247 1233 1226 1226
query25 582 488 444 444
query26 1251 292 180 180
query27 2711 469 324 324
query28 4465 2164 2167 2164
query29 843 588 480 480
query30 315 245 218 218
query31 839 709 630 630
query32 81 70 70 70
query33 558 347 308 308
query34 919 898 548 548
query35 794 838 737 737
query36 886 944 837 837
query37 127 87 79 79
query38 2842 2874 2778 2778
query39 753 730 718 718
query39_1 690 700 682 682
query40 226 137 122 122
query41 68 63 62 62
query42 105 101 104 101
query43 428 431 402 402
query44 1314 738 743 738
query45 194 190 183 183
query46 879 974 611 611
query47 1665 1719 1597 1597
query48 317 320 242 242
query49 628 435 349 349
query50 665 298 224 224
query51 3763 3803 3742 3742
query52 101 109 99 99
query53 320 355 294 294
query54 284 259 249 249
query55 88 77 73 73
query56 310 298 281 281
query57 1186 1121 1088 1088
query58 271 251 253 251
query59 2422 2530 2346 2346
query60 309 316 289 289
query61 166 157 159 157
query62 706 666 647 647
query63 323 295 297 295
query64 4964 1333 1008 1008
query65 3989 3914 3965 3914
query66 1434 447 317 317
query67 15103 14918 14645 14645
query68 8465 1009 734 734
query69 478 353 320 320
query70 1081 997 958 958
query71 386 306 285 285
query72 6237 4900 4939 4900
query73 693 595 314 314
query74 8869 8917 8593 8593
query75 3194 3121 2766 2766
query76 4048 1133 744 744
query77 588 382 293 293
query78 9477 9531 8818 8818
query79 1643 857 626 626
query80 796 648 554 554
query81 512 269 232 232
query82 433 129 106 106
query83 253 253 239 239
query84 269 120 98 98
query85 912 518 474 474
query86 419 307 286 286
query87 2997 3059 2911 2911
query88 3297 2256 2230 2230
query89 471 418 386 386
query90 2149 156 156 156
query91 177 166 143 143
query92 87 67 63 63
query93 1959 883 550 550
query94 496 322 276 276
query95 563 323 359 323
query96 580 470 207 207
query97 2257 2298 2257 2257
query98 219 195 186 186
query99 1275 1306 1205 1205
Total cold run time: 262149 ms
Total hot run time: 177598 ms
ClickBench: Total hot run time: 27.2 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e4518bb504d12d9fe8b026a13acfe67f671c58eb, data reload: false
query1 0.06 0.05 0.05
query2 0.10 0.05 0.04
query3 0.25 0.09 0.09
query4 1.62 0.11 0.12
query5 0.27 0.25 0.27
query6 1.16 0.67 0.64
query7 0.04 0.03 0.02
query8 0.06 0.04 0.05
query9 0.57 0.51 0.51
query10 0.56 0.56 0.55
query11 0.15 0.11 0.12
query12 0.16 0.11 0.12
query13 0.61 0.60 0.60
query14 1.00 0.99 0.99
query15 0.80 0.80 0.81
query16 0.40 0.40 0.42
query17 0.97 1.05 0.98
query18 0.23 0.22 0.21
query19 1.91 1.83 1.87
query20 0.02 0.01 0.02
query21 15.44 0.31 0.14
query22 4.66 0.05 0.04
query23 16.12 0.28 0.10
query24 0.96 0.29 0.18
query25 0.06 0.08 0.05
query26 0.15 0.14 0.13
query27 0.06 0.06 0.06
query28 3.10 1.24 1.03
query29 12.67 3.93 3.24
query30 0.27 0.14 0.11
query31 2.82 0.62 0.40
query32 3.23 0.55 0.46
query33 3.04 2.99 3.00
query34 17.00 5.20 4.58
query35 4.53 4.52 4.56
query36 0.67 0.49 0.49
query37 0.11 0.06 0.07
query38 0.07 0.04 0.04
query39 0.04 0.03 0.03
query40 0.17 0.14 0.13
query41 0.08 0.04 0.03
query42 0.05 0.03 0.04
query43 0.04 0.03 0.02
Total cold run time: 96.28 s
Total hot run time: 27.2 s
TPC-H: Total hot run time: 35391 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7463d5617cfa4d6afd01f0b14f27397a1c4e145e, data reload: false
------ Round 1 ----------------------------------
q1 17753 4199 4077 4077
q2 2195 345 229 229
q3 10335 1316 745 745
q4 10266 889 310 310
q5 7449 2145 1911 1911
q6 179 164 133 133
q7 998 865 710 710
q8 9354 1446 1238 1238
q9 7271 5424 5465 5424
q10 7218 2396 1971 1971
q11 560 307 308 307
q12 672 742 604 604
q13 17777 3652 3044 3044
q14 290 289 269 269
q15 591 515 504 504
q16 704 665 623 623
q17 679 730 615 615
q18 7566 7075 7042 7042
q19 1178 948 619 619
q20 397 353 243 243
q21 4262 3968 3797 3797
q22 1013 995 976 976
Total cold run time: 108707 ms
Total hot run time: 35391 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4103 4018 4088 4018
q2 327 423 307 307
q3 2104 2663 2287 2287
q4 1310 1769 1304 1304
q5 4205 5053 4672 4672
q6 215 174 128 128
q7 1980 1988 1818 1818
q8 2591 2431 2491 2431
q9 7553 7563 7442 7442
q10 3132 3219 2860 2860
q11 613 517 519 517
q12 769 822 604 604
q13 3599 4052 3281 3281
q14 306 324 296 296
q15 560 505 520 505
q16 688 684 639 639
q17 1163 1422 1457 1422
q18 7792 7724 7676 7676
q19 879 894 890 890
q20 1909 2016 1847 1847
q21 4653 4175 4124 4124
q22 1076 1049 989 989
Total cold run time: 51527 ms
Total hot run time: 50057 ms
TPC-DS: Total hot run time: 178495 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7463d5617cfa4d6afd01f0b14f27397a1c4e145e, data reload: false
query5 5372 608 454 454
query6 351 237 212 212
query7 4223 453 274 274
query8 306 246 241 241
query9 8775 2519 2532 2519
query10 559 353 331 331
query11 15382 14935 14609 14609
query12 184 116 116 116
query13 1264 502 381 381
query14 6321 3247 3007 3007
query14_1 2886 2891 2875 2875
query15 207 198 185 185
query16 944 435 456 435
query17 1124 712 623 623
query18 2710 451 359 359
query19 245 227 205 205
query20 118 120 110 110
query21 221 139 118 118
query22 3909 3908 3809 3809
query23 17133 16196 16041 16041
query23_1 16225 16068 16055 16055
query24 7366 1667 1250 1250
query24_1 1266 1234 1267 1234
query25 605 499 441 441
query26 1024 279 173 173
query27 2712 464 317 317
query28 4457 2133 2132 2132
query29 824 580 483 483
query30 313 251 219 219
query31 804 709 616 616
query32 81 73 68 68
query33 543 336 299 299
query34 906 921 540 540
query35 788 821 758 758
query36 913 910 806 806
query37 129 91 79 79
query38 2829 2846 2816 2816
query39 766 736 865 736
query39_1 715 713 700 700
query40 220 135 121 121
query41 85 80 76 76
query42 113 106 100 100
query43 433 431 416 416
query44 1323 748 736 736
query45 192 190 179 179
query46 881 983 636 636
query47 1653 1707 1607 1607
query48 310 331 255 255
query49 625 418 346 346
query50 675 288 236 236
query51 3770 3877 3840 3840
query52 107 108 108 108
query53 324 349 292 292
query54 286 254 243 243
query55 77 76 75 75
query56 297 290 297 290
query57 1162 1123 1086 1086
query58 262 255 259 255
query59 2405 2504 2390 2390
query60 318 319 288 288
query61 160 161 198 161
query62 696 673 624 624
query63 328 294 301 294
query64 4651 1318 1019 1019
query65 4009 3940 3932 3932
query66 1355 460 321 321
query67 15181 15060 14837 14837
query68 8431 995 733 733
query69 514 343 308 308
query70 1074 1003 982 982
query71 391 308 279 279
query72 6225 5006 5083 5006
query73 721 673 318 318
query74 8818 8757 8542 8542
query75 3226 3133 2771 2771
query76 4036 1169 775 775
query77 607 416 301 301
query78 9383 9388 8866 8866
query79 1676 868 622 622
query80 723 651 539 539
query81 511 276 234 234
query82 501 137 107 107
query83 286 255 239 239
query84 303 121 103 103
query85 927 522 463 463
query86 378 290 278 278
query87 3034 3057 2971 2971
query88 4219 2257 2268 2257
query89 468 426 397 397
query90 2167 160 152 152
query91 184 175 143 143
query92 78 71 75 71
query93 1891 930 556 556
query94 475 302 287 287
query95 554 325 362 325
query96 598 474 209 209
query97 2296 2311 2211 2211
query98 212 192 188 188
query99 1329 1306 1170 1170
Total cold run time: 263381 ms
Total hot run time: 178495 ms
ClickBench: Total hot run time: 27.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7463d5617cfa4d6afd01f0b14f27397a1c4e145e, data reload: false
query1 0.05 0.04 0.04
query2 0.09 0.05 0.05
query3 0.25 0.08 0.08
query4 1.60 0.10 0.11
query5 0.26 0.26 0.27
query6 1.16 0.63 0.64
query7 0.03 0.02 0.02
query8 0.06 0.04 0.04
query9 0.58 0.53 0.52
query10 0.56 0.56 0.55
query11 0.16 0.12 0.11
query12 0.14 0.11 0.11
query13 0.62 0.61 0.60
query14 1.00 0.96 0.98
query15 0.81 0.79 0.79
query16 0.41 0.39 0.40
query17 0.97 1.01 1.00
query18 0.23 0.21 0.22
query19 1.92 1.87 1.75
query20 0.02 0.01 0.01
query21 15.43 0.31 0.14
query22 4.62 0.06 0.04
query23 15.97 0.27 0.10
query24 2.04 0.32 0.47
query25 0.06 0.05 0.05
query26 0.14 0.14 0.13
query27 0.06 0.06 0.06
query28 4.03 1.22 1.03
query29 12.59 3.92 3.33
query30 0.28 0.14 0.12
query31 2.82 0.64 0.39
query32 3.22 0.55 0.46
query33 2.96 3.05 2.94
query34 16.54 5.18 4.54
query35 4.56 4.58 4.59
query36 0.66 0.50 0.49
query37 0.11 0.08 0.06
query38 0.07 0.03 0.04
query39 0.05 0.03 0.03
query40 0.16 0.15 0.14
query41 0.09 0.03 0.03
query42 0.05 0.03 0.03
query43 0.05 0.04 0.03
Total cold run time: 97.48 s
Total hot run time: 27.29 s
BE UT Coverage Report
Increment line coverage 52.50% (21/40) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 53.43% (18832/35243) |
| Line Coverage | 39.18% (174149/444458) |
| Region Coverage | 33.81% (134821/398743) |
| Branch Coverage | 34.76% (58027/166928) |
BE Regression && UT Coverage Report
Increment line coverage 100.00% (40/40) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 73.18% (25277/34540) |
| Line Coverage | 60.35% (267907/443953) |
| Region Coverage | 55.94% (225699/403459) |
| Branch Coverage | 57.15% (95902/167801) |
TPC-H: Total hot run time: 36153 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit db41239f2ef97750eb94d57dd2aced82ef913ee8, data reload: false
------ Round 1 ----------------------------------
q1 17577 4298 4085 4085
q2 2027 355 238 238
q3 10169 1324 730 730
q4 10206 820 312 312
q5 7472 2177 1893 1893
q6 189 169 135 135
q7 1015 851 726 726
q8 9337 1448 1155 1155
q9 7068 5365 5388 5365
q10 6844 2398 1961 1961
q11 539 328 300 300
q12 689 711 577 577
q13 17765 3724 3045 3045
q14 289 303 273 273
q15 589 516 513 513
q16 696 692 623 623
q17 710 796 568 568
q18 7625 7616 8029 7616
q19 1780 1020 633 633
q20 425 382 255 255
q21 4624 4282 4102 4102
q22 1115 1108 1048 1048
Total cold run time: 108750 ms
Total hot run time: 36153 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4271 4300 4202 4202
q2 345 422 320 320
q3 2515 2921 2509 2509
q4 1424 1936 1385 1385
q5 4569 4497 4580 4497
q6 210 163 124 124
q7 2004 1955 1741 1741
q8 2655 2509 2481 2481
q9 7858 7472 6917 6917
q10 2906 3091 2677 2677
q11 566 497 468 468
q12 630 699 576 576
q13 3272 3634 3010 3010
q14 328 277 253 253
q15 528 505 488 488
q16 619 640 602 602
q17 1072 1329 1363 1329
q18 7382 7085 7077 7077
q19 854 815 816 815
q20 1901 1962 1824 1824
q21 4579 4259 4183 4183
q22 1066 998 963 963
Total cold run time: 51554 ms
Total hot run time: 48441 ms