doris
doris copied to clipboard
Published
20 hours ago •
apache
apache
[Feature] Support to do schema change in cloud mode
Proposed changes
Issue Number: close #xxx
Refactor the codes about schema change and support to do schema change in cloud mode.
Further comments
If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
TeamCity be ut coverage result: Function Coverage: 35.77% (8561/23936) Line Coverage: 27.74% (69452/250387) Region Coverage: 26.86% (36042/134172) Branch Coverage: 23.67% (18435/77882) Coverage Report: http://coverage.selectdb-in.cc/coverage/0e5542d65b1df0205dec9497e0572a4b7e811305_0e5542d65b1df0205dec9497e0572a4b7e811305/report/index.html
TeamCity be ut coverage result: Function Coverage: 35.75% (8557/23939) Line Coverage: 27.68% (69406/250703) Region Coverage: 26.81% (36019/134345) Branch Coverage: 23.62% (18418/77972) Coverage Report: http://coverage.selectdb-in.cc/coverage/8f978436709a8c3fc1ee6cbe43e8d84158461e39_8f978436709a8c3fc1ee6cbe43e8d84158461e39/report/index.html
TPC-H: Total hot run time: 41455 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4c39df9bc6dab64b7fb1910d6f85b4de075672c3, data reload: false
------ Round 1 ----------------------------------
q1 17668 5032 4918 4918
q2 2068 147 144 144
q3 10623 1018 1003 1003
q4 4740 1009 1009 1009
q5 7677 3126 3219 3126
q6 203 142 145 142
q7 1275 793 792 792
q8 9370 2087 2076 2076
q9 7488 6617 6606 6606
q10 8338 2653 2668 2653
q11 415 211 230 211
q12 797 345 343 343
q13 17942 3608 3634 3608
q14 302 260 258 258
q15 601 515 509 509
q16 480 415 423 415
q17 938 878 839 839
q18 7535 6717 6655 6655
q19 1566 1524 1503 1503
q20 560 285 293 285
q21 6832 4032 4010 4010
q22 894 362 350 350
Total cold run time: 108312 ms
Total hot run time: 41455 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4927 4881 4874 4874
q2 302 189 194 189
q3 3637 3613 3628 3613
q4 2552 2527 2547 2527
q5 5793 5785 5781 5781
q6 218 133 134 133
q7 2286 1682 1677 1677
q8 3060 3168 3150 3150
q9 8757 8744 8712 8712
q10 6876 4255 4249 4249
q11 511 398 385 385
q12 788 559 553 553
q13 4349 3430 3408 3408
q14 280 237 228 228
q15 663 550 513 513
q16 482 467 451 451
q17 1738 1630 1632 1630
q18 8326 7674 7554 7554
q19 1652 1650 1661 1650
q20 2144 1846 1851 1846
q21 6676 6306 6282 6282
q22 584 525 531 525
Total cold run time: 66601 ms
Total hot run time: 59930 ms
TeamCity be ut coverage result: Function Coverage: 35.68% (8547/23954) Line Coverage: 27.48% (69359/252355) Region Coverage: 26.65% (35979/134995) Branch Coverage: 23.46% (18391/78392) Coverage Report: http://coverage.selectdb-in.cc/coverage/4c39df9bc6dab64b7fb1910d6f85b4de075672c3_4c39df9bc6dab64b7fb1910d6f85b4de075672c3/report/index.html
TPC-DS: Total hot run time: 188798 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4c39df9bc6dab64b7fb1910d6f85b4de075672c3, data reload: false
query1 932 356 355 355
query2 6619 1889 1997 1889
query3 6740 259 263 259
query4 23180 21317 21185 21185
query5 4528 651 640 640
query6 328 239 246 239
query7 4682 357 351 351
query8 316 254 260 254
query9 9335 3691 3691 3691
query10 598 388 392 388
query11 15162 14591 14578 14578
query12 200 141 141 141
query13 1740 478 483 478
query14 9951 8581 8703 8581
query15 258 241 236 236
query16 7542 359 359 359
query17 1300 667 638 638
query18 2012 331 328 328
query19 264 213 218 213
query20 143 142 142 142
query21 202 120 126 120
query22 4995 4739 4713 4713
query23 32995 31992 31939 31939
query24 12837 3568 3499 3499
query25 759 481 474 474
query26 1941 210 223 210
query27 2958 372 377 372
query28 6685 2170 2163 2163
query29 1292 723 729 723
query30 288 145 146 145
query31 1022 851 866 851
query32 150 120 113 113
query33 936 441 444 441
query34 941 554 545 545
query35 1109 1010 1021 1010
query36 1067 961 997 961
query37 229 108 112 108
query38 3467 3366 3397 3366
query39 1373 1347 1335 1335
query40 337 163 159 159
query41 38 37 36 36
query42 152 147 145 145
query43 540 489 514 489
query44 1366 1000 1024 1000
query45 257 247 244 244
query46 1113 859 846 846
query47 1719 1559 1638 1559
query48 473 421 403 403
query49 1516 589 578 578
query50 827 424 424 424
query51 4597 4446 4555 4446
query52 155 146 143 143
query53 456 364 372 364
query54 544 484 487 484
query55 134 127 135 127
query56 411 390 404 390
query57 1139 1003 985 985
query58 398 382 376 376
query59 2313 2356 2202 2202
query60 446 436 419 419
query61 232 230 231 230
query62 642 449 468 449
query63 392 346 345 345
query64 6568 3293 3348 3293
query65 3423 3362 3356 3356
query66 1501 466 459 459
query67 14628 14490 14235 14235
query68 3857 643 637 637
query69 652 526 527 526
query70 1448 1365 1360 1360
query71 517 432 440 432
query72 6212 2856 2679 2679
query73 766 377 375 375
query74 6978 6596 6555 6555
query75 3355 2756 2735 2735
query76 2473 1321 1361 1321
query77 539 438 444 438
query78 9570 8965 8963 8963
query79 1012 570 563 563
query80 760 585 564 564
query81 445 208 215 208
query82 222 130 131 130
query83 168 145 145 145
query84 231 81 84 81
query85 1023 437 423 423
query86 365 382 382 382
query87 3675 3406 3460 3406
query88 3233 2777 2767 2767
query89 500 427 422 422
query90 2130 274 268 268
query91 159 133 134 133
query92 115 105 110 105
query93 1062 560 542 542
query94 1288 282 280 280
query95 577 466 476 466
query96 631 314 313 313
query97 4556 4395 4340 4340
query98 273 259 251 251
query99 1119 769 815 769
Total cold run time: 277304 ms
Total hot run time: 188798 ms
ClickBench: Total hot run time: 30.72 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4c39df9bc6dab64b7fb1910d6f85b4de075672c3, data reload: false
query1 0.03 0.02 0.02
query2 0.07 0.03 0.03
query3 0.23 0.07 0.07
query4 1.66 0.08 0.08
query5 0.49 0.48 0.49
query6 1.39 0.61 0.61
query7 0.02 0.01 0.01
query8 0.04 0.03 0.03
query9 0.52 0.45 0.45
query10 0.50 0.48 0.50
query11 0.13 0.10 0.10
query12 0.12 0.10 0.11
query13 0.61 0.59 0.58
query14 0.76 0.79 0.80
query15 0.83 0.80 0.78
query16 0.32 0.33 0.34
query17 0.91 0.91 0.90
query18 0.18 0.16 0.16
query19 1.72 1.69 1.67
query20 0.02 0.01 0.02
query21 15.43 0.62 0.60
query22 3.13 3.86 2.30
query23 17.41 0.93 0.94
query24 2.07 0.77 0.18
query25 0.52 0.06 0.05
query26 0.18 0.14 0.14
query27 0.06 0.05 0.05
query28 12.04 0.87 0.83
query29 12.51 3.35 3.27
query30 0.53 0.50 0.47
query31 2.78 0.37 0.37
query32 3.34 0.48 0.48
query33 3.13 3.13 3.19
query34 15.38 4.52 4.51
query35 4.53 4.49 4.48
query36 1.09 0.95 0.96
query37 0.07 0.06 0.05
query38 0.04 0.04 0.04
query39 0.02 0.02 0.01
query40 0.17 0.15 0.15
query41 0.07 0.02 0.02
query42 0.02 0.01 0.02
query43 0.03 0.02 0.02
Total cold run time: 105.1 s
Total hot run time: 30.72 s
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 4c39df9bc6dab64b7fb1910d6f85b4de075672c3 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 16.7 seconds inserted 10000000 Rows, about 598K ops/s
TeamCity be ut coverage result: Function Coverage: 35.69% (8548/23954) Line Coverage: 27.49% (69364/252354) Region Coverage: 26.65% (35972/134994) Branch Coverage: 23.46% (18387/78390) Coverage Report: http://coverage.selectdb-in.cc/coverage/2aa2beec6bb2f53125e45fdc6b74a67c6b52c8a0_2aa2beec6bb2f53125e45fdc6b74a67c6b52c8a0/report/index.html
TPC-H: Total hot run time: 41239 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2aa2beec6bb2f53125e45fdc6b74a67c6b52c8a0, data reload: false
------ Round 1 ----------------------------------
q1 17650 4999 4891 4891
q2 2045 141 136 136
q3 10577 1000 994 994
q4 4666 960 974 960
q5 7623 3153 3230 3153
q6 198 144 144 144
q7 1264 792 776 776
q8 9266 2063 2084 2063
q9 7471 6581 6599 6581
q10 8313 2655 2664 2655
q11 407 227 219 219
q12 804 331 337 331
q13 17947 3608 3613 3608
q14 294 264 264 264
q15 594 523 514 514
q16 477 405 440 405
q17 937 887 884 884
q18 7493 6670 6619 6619
q19 1540 1492 1492 1492
q20 550 279 274 274
q21 6703 3934 3963 3934
q22 882 352 342 342
Total cold run time: 107701 ms
Total hot run time: 41239 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4867 4884 4854 4854
q2 299 187 199 187
q3 3603 3606 3611 3606
q4 2575 2656 2583 2583
q5 5771 5758 5770 5758
q6 215 131 131 131
q7 2292 1719 1654 1654
q8 3044 3110 3118 3110
q9 8794 8775 8722 8722
q10 6807 4250 4264 4250
q11 510 419 397 397
q12 792 552 567 552
q13 4419 3434 3434 3434
q14 279 240 239 239
q15 603 547 510 510
q16 491 440 453 440
q17 1679 1625 1615 1615
q18 8291 7780 7689 7689
q19 1646 1669 1635 1635
q20 2136 1855 1848 1848
q21 6660 6278 6309 6278
q22 593 532 525 525
Total cold run time: 66366 ms
Total hot run time: 60017 ms
TPC-H: Total hot run time: 41483 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f1b93e9f82eb44a5a13bcee8e2897107692e704e, data reload: false
------ Round 1 ----------------------------------
q1 17607 5025 4915 4915
q2 2054 142 138 138
q3 10669 1000 1001 1000
q4 4762 998 1002 998
q5 7650 3191 3229 3191
q6 199 145 139 139
q7 1267 791 799 791
q8 9408 2105 2107 2105
q9 7675 6656 6649 6649
q10 8404 2648 2648 2648
q11 423 221 220 220
q12 988 372 382 372
q13 17977 3629 3603 3603
q14 298 263 268 263
q15 612 530 555 530
q16 539 400 427 400
q17 955 875 844 844
q18 7534 6729 6602 6602
q19 1583 1510 1509 1509
q20 553 285 287 285
q21 6705 3949 4004 3949
q22 875 347 332 332
Total cold run time: 108737 ms
Total hot run time: 41483 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4855 4857 4867 4857
q2 297 187 186 186
q3 3598 3601 3591 3591
q4 2599 2556 2576 2556
q5 5778 5843 5753 5753
q6 213 128 131 128
q7 2270 1700 1693 1693
q8 3126 3184 3196 3184
q9 8945 8877 8748 8748
q10 6850 4285 4269 4269
q11 538 384 378 378
q12 778 558 560 558
q13 4300 3439 3428 3428
q14 280 248 234 234
q15 619 549 521 521
q16 513 452 436 436
q17 1679 1616 1610 1610
q18 8391 7657 7695 7657
q19 1645 1656 1652 1652
q20 2131 1842 1833 1833
q21 6602 6205 6154 6154
q22 590 518 514 514
Total cold run time: 66597 ms
Total hot run time: 59940 ms
TeamCity be ut coverage result: Function Coverage: 35.69% (8548/23954) Line Coverage: 27.49% (69362/252355) Region Coverage: 26.65% (35970/134994) Branch Coverage: 23.46% (18388/78390) Coverage Report: http://coverage.selectdb-in.cc/coverage/f1b93e9f82eb44a5a13bcee8e2897107692e704e_f1b93e9f82eb44a5a13bcee8e2897107692e704e/report/index.html
TPC-DS: Total hot run time: 188388 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f1b93e9f82eb44a5a13bcee8e2897107692e704e, data reload: false
query1 939 348 350 348
query2 6464 1797 1743 1743
query3 5549 255 262 255
query4 22720 21307 21256 21256
query5 3431 660 642 642
query6 295 239 233 233
query7 3072 347 353 347
query8 267 243 250 243
query9 6816 3665 3648 3648
query10 537 406 389 389
query11 15029 14451 14549 14451
query12 192 140 139 139
query13 985 481 467 467
query14 9398 8442 8457 8442
query15 259 229 236 229
query16 5905 352 359 352
query17 967 657 637 637
query18 1514 332 327 327
query19 263 210 211 210
query20 146 137 140 137
query21 195 120 118 118
query22 5009 4874 4806 4806
query23 33022 32109 32037 32037
query24 11835 3470 3481 3470
query25 768 475 488 475
query26 1910 210 213 210
query27 2908 377 386 377
query28 6031 2170 2166 2166
query29 1270 725 718 718
query30 287 143 147 143
query31 1024 857 861 857
query32 156 116 111 111
query33 896 440 458 440
query34 928 545 550 545
query35 1113 1005 1014 1005
query36 1053 989 924 924
query37 307 104 105 104
query38 3475 3345 3349 3345
query39 1368 1329 1332 1329
query40 302 165 161 161
query41 38 37 35 35
query42 154 147 143 143
query43 522 495 489 489
query44 1309 998 1018 998
query45 260 242 246 242
query46 1092 849 823 823
query47 1762 1616 1635 1616
query48 466 409 397 397
query49 1012 582 581 581
query50 834 418 421 418
query51 4589 4412 4453 4412
query52 154 141 139 139
query53 456 359 369 359
query54 551 481 488 481
query55 132 136 126 126
query56 418 396 410 396
query57 1142 1022 995 995
query58 410 371 377 371
query59 2276 2096 2207 2096
query60 445 432 429 429
query61 243 242 234 234
query62 660 422 424 422
query63 384 356 349 349
query64 6884 3283 3329 3283
query65 3404 3396 3362 3362
query66 1597 458 449 449
query67 14687 14417 14226 14226
query68 3946 651 651 651
query69 650 528 529 528
query70 1400 1344 1406 1344
query71 484 429 437 429
query72 6106 2892 2720 2720
query73 757 374 374 374
query74 6978 6613 6566 6566
query75 3335 2731 2733 2731
query76 2495 1329 1380 1329
query77 551 443 438 438
query78 9555 9001 9039 9001
query79 1010 567 577 567
query80 752 611 576 576
query81 445 213 206 206
query82 293 133 135 133
query83 169 143 136 136
query84 248 82 81 81
query85 1162 446 436 436
query86 354 367 365 365
query87 3659 3418 3434 3418
query88 3139 2778 2797 2778
query89 496 422 420 420
query90 1972 269 271 269
query91 161 132 134 132
query92 114 104 105 104
query93 1061 572 546 546
query94 1275 287 288 287
query95 577 458 464 458
query96 621 313 312 312
query97 4541 4353 4388 4353
query98 265 257 247 247
query99 1088 746 804 746
Total cold run time: 264145 ms
Total hot run time: 188388 ms
ClickBench: Total hot run time: 31.02 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f1b93e9f82eb44a5a13bcee8e2897107692e704e, data reload: false
query1 0.03 0.03 0.02
query2 0.07 0.02 0.02
query3 0.23 0.07 0.08
query4 1.62 0.08 0.09
query5 0.48 0.47 0.48
query6 1.31 0.61 0.62
query7 0.01 0.01 0.02
query8 0.04 0.02 0.03
query9 0.53 0.46 0.44
query10 0.49 0.49 0.49
query11 0.12 0.09 0.10
query12 0.12 0.10 0.10
query13 0.58 0.59 0.58
query14 0.75 0.79 0.77
query15 0.81 0.81 0.78
query16 0.33 0.32 0.33
query17 0.87 0.89 0.94
query18 0.17 0.16 0.17
query19 1.63 1.66 1.67
query20 0.02 0.01 0.01
query21 15.43 0.60 0.58
query22 2.94 3.83 2.49
query23 17.29 1.13 1.05
query24 2.26 0.41 0.31
query25 0.58 0.07 0.05
query26 0.16 0.13 0.14
query27 0.06 0.07 0.04
query28 11.96 0.84 0.81
query29 12.67 3.46 3.36
query30 0.58 0.49 0.50
query31 2.78 0.35 0.35
query32 3.32 0.47 0.47
query33 3.14 3.12 3.16
query34 15.36 4.49 4.50
query35 4.50 4.49 4.51
query36 1.09 0.95 0.93
query37 0.08 0.05 0.05
query38 0.04 0.03 0.03
query39 0.03 0.01 0.01
query40 0.18 0.15 0.14
query41 0.07 0.02 0.01
query42 0.03 0.02 0.01
query43 0.03 0.02 0.02
Total cold run time: 104.79 s
Total hot run time: 31.02 s
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit f1b93e9f82eb44a5a13bcee8e2897107692e704e with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 18.1 seconds inserted 10000000 Rows, about 552K ops/s
TPC-H: Total hot run time: 38581 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0a5beb4bfbed94845f74aa74bf451b7573f6eb85, data reload: false
------ Round 1 ----------------------------------
q1 18252 4220 4200 4200
q2 2143 158 142 142
q3 11678 990 973 973
q4 5756 976 979 976
q5 7826 2991 3523 2991
q6 190 137 129 129
q7 1308 820 810 810
q8 9424 2080 2066 2066
q9 7231 6364 6320 6320
q10 8219 2507 2537 2507
q11 424 204 223 204
q12 754 316 323 316
q13 17955 3241 3281 3241
q14 286 251 255 251
q15 546 507 504 504
q16 486 403 410 403
q17 958 922 912 912
q18 6535 5970 6183 5970
q19 1596 1532 1529 1529
q20 562 286 281 281
q21 6457 3560 3660 3560
q22 818 303 296 296
Total cold run time: 109404 ms
Total hot run time: 38581 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4031 4051 4029 4029
q2 309 217 219 217
q3 2999 2978 2953 2953
q4 1903 1857 1862 1857
q5 5200 5164 5196 5164
q6 208 133 120 120
q7 2133 1713 1707 1707
q8 3184 3227 3240 3227
q9 8305 8302 8234 8234
q10 6254 3680 3658 3658
q11 515 427 436 427
q12 687 554 545 545
q13 3888 3079 3091 3079
q14 276 249 251 249
q15 551 501 504 501
q16 492 454 453 453
q17 1715 1703 1699 1699
q18 7921 7634 7470 7470
q19 1678 1661 1659 1659
q20 2102 1922 1909 1909
q21 4915 4740 4675 4675
q22 514 450 455 450
Total cold run time: 59780 ms
Total hot run time: 54282 ms
TeamCity be ut coverage result: Function Coverage: 35.70% (8547/23940) Line Coverage: 27.49% (69353/252295) Region Coverage: 26.64% (35968/134992) Branch Coverage: 23.45% (18384/78398) Coverage Report: http://coverage.selectdb-in.cc/coverage/0a5beb4bfbed94845f74aa74bf451b7573f6eb85_0a5beb4bfbed94845f74aa74bf451b7573f6eb85/report/index.html
TPC-DS: Total hot run time: 181831 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0a5beb4bfbed94845f74aa74bf451b7573f6eb85, data reload: false
query1 946 347 344 344
query2 6624 1855 1864 1855
query3 6760 259 265 259
query4 23315 20823 20625 20625
query5 4595 638 628 628
query6 336 247 248 247
query7 4670 351 364 351
query8 332 247 246 246
query9 9365 3098 3093 3093
query10 603 399 395 395
query11 14661 14219 14191 14191
query12 194 140 139 139
query13 1684 480 494 480
query14 9301 7498 7640 7498
query15 263 231 221 221
query16 7202 363 358 358
query17 988 630 622 622
query18 1961 339 334 334
query19 258 222 215 215
query20 152 136 142 136
query21 199 138 133 133
query22 4599 4648 4638 4638
query23 31263 30470 30518 30470
query24 11926 3202 3226 3202
query25 767 463 460 460
query26 1946 210 219 210
query27 2933 368 382 368
query28 7113 2105 2102 2102
query29 1343 672 667 667
query30 294 136 147 136
query31 969 777 786 777
query32 151 119 110 110
query33 940 442 446 442
query34 948 536 540 536
query35 1070 940 933 933
query36 1003 952 942 942
query37 222 110 109 109
query38 3301 3173 3217 3173
query39 1337 1255 1270 1255
query40 334 161 161 161
query41 40 39 37 37
query42 152 145 143 143
query43 506 480 485 480
query44 1384 984 1006 984
query45 250 238 238 238
query46 1104 867 879 867
query47 1542 1539 1477 1477
query48 472 399 394 394
query49 1478 573 578 573
query50 832 423 424 423
query51 4516 4517 4513 4513
query52 148 143 139 139
query53 409 334 339 334
query54 552 481 485 481
query55 137 127 133 127
query56 414 394 399 394
query57 1042 987 947 947
query58 398 384 377 377
query59 2350 2241 2242 2241
query60 445 421 424 421
query61 235 235 235 235
query62 640 412 400 400
query63 350 324 334 324
query64 6682 3226 3362 3226
query65 3359 3321 3358 3321
query66 1561 468 445 445
query67 14540 14382 14013 14013
query68 5010 625 628 625
query69 713 548 565 548
query70 1457 1353 1285 1285
query71 559 441 433 433
query72 6366 2907 2724 2724
query73 777 386 378 378
query74 6399 6139 6183 6139
query75 3230 2614 2586 2586
query76 2960 1228 1321 1228
query77 556 445 431 431
query78 9264 8813 8697 8697
query79 1154 576 576 576
query80 1165 596 576 576
query81 489 201 198 198
query82 1083 130 135 130
query83 247 144 134 134
query84 290 85 82 82
query85 1397 433 426 426
query86 455 348 356 348
query87 3402 3286 3226 3226
query88 3198 2778 2776 2776
query89 465 390 399 390
query90 1962 275 271 271
query91 157 127 126 126
query92 113 111 105 105
query93 1154 535 536 535
query94 1403 281 288 281
query95 566 470 475 470
query96 616 308 323 308
query97 4364 4232 4270 4232
query98 273 252 253 252
query99 1143 703 700 700
Total cold run time: 274793 ms
Total hot run time: 181831 ms
ClickBench: Total hot run time: 31.92 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0a5beb4bfbed94845f74aa74bf451b7573f6eb85, data reload: false
query1 0.04 0.04 0.03
query2 0.06 0.02 0.02
query3 0.24 0.07 0.06
query4 1.66 0.10 0.10
query5 0.53 0.52 0.52
query6 1.24 0.70 0.67
query7 0.01 0.01 0.01
query8 0.04 0.03 0.03
query9 0.54 0.52 0.50
query10 0.56 0.54 0.57
query11 0.12 0.09 0.09
query12 0.13 0.10 0.11
query13 0.61 0.61 0.61
query14 0.79 0.80 0.80
query15 0.84 0.81 0.81
query16 0.37 0.36 0.38
query17 0.97 0.96 0.96
query18 0.26 0.25 0.25
query19 1.84 1.72 1.72
query20 0.02 0.01 0.01
query21 15.41 0.67 0.66
query22 2.75 3.76 2.20
query23 17.58 1.05 0.99
query24 1.96 0.58 0.20
query25 0.47 0.17 0.06
query26 0.16 0.15 0.15
query27 0.06 0.04 0.04
query28 12.28 0.83 0.83
query29 12.67 3.23 3.25
query30 0.56 0.55 0.53
query31 2.80 0.35 0.36
query32 3.35 0.47 0.48
query33 3.21 3.24 3.21
query34 15.38 4.73 4.75
query35 4.74 4.74 4.72
query36 1.14 1.06 1.08
query37 0.06 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.02 0.02
query40 0.17 0.14 0.14
query41 0.07 0.02 0.02
query42 0.03 0.02 0.02
query43 0.02 0.02 0.02
Total cold run time: 105.8 s
Total hot run time: 31.92 s
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Load test result on commit 0a5beb4bfbed94845f74aa74bf451b7573f6eb85 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 18.1 seconds inserted 10000000 Rows, about 552K ops/s