doris
doris copied to clipboard
Published
20 hours ago •
apache
apache
[ci](perf) adjust exsits meta and data path
What problem does this PR solve?
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
Release note
None
Check List (For Author)
-
Test
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
-
Behavior changed:
- [ ] No.
- [ ] Yes.
-
Does this need documentation?
- [ ] No.
- [ ] Yes.
Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
- What problem was fixed (it's best to include specific error reporting information). How it was fixed.
- Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
- What features were added. Why was this function added?
- Which code was refactored and why was this part of the code refactored?
- Which functions were optimized and what is the difference before and after the optimization?
TPC-H: Total hot run time: 39723 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d1ec3eaac72b648f6534838fc96be69dc9b63d31, data reload: false
------ Round 1 ----------------------------------
q1 17583 7182 6604 6604
q2 2074 170 177 170
q3 10795 1112 1227 1112
q4 10551 734 695 695
q5 7764 2871 2783 2783
q6 217 135 131 131
q7 981 632 607 607
q8 9369 1969 2035 1969
q9 6531 6401 6415 6401
q10 7011 2240 2292 2240
q11 457 261 254 254
q12 399 213 214 213
q13 17788 2969 3018 2969
q14 235 200 211 200
q15 502 466 474 466
q16 499 378 382 378
q17 976 521 615 521
q18 7479 6666 6803 6666
q19 1406 1102 1119 1102
q20 467 197 200 197
q21 3942 3176 3076 3076
q22 1087 969 978 969
Total cold run time: 108113 ms
Total hot run time: 39723 ms
----- Round 2, with runtime_filter_mode=off -----
q1 6595 6552 6547 6547
q2 329 229 239 229
q3 2908 2782 2920 2782
q4 2016 1836 1763 1763
q5 5779 5775 5726 5726
q6 209 131 131 131
q7 2201 1789 1786 1786
q8 3403 3546 3512 3512
q9 8907 8728 8933 8728
q10 3567 3493 3528 3493
q11 596 480 516 480
q12 835 572 617 572
q13 8141 3211 3110 3110
q14 300 272 273 272
q15 518 460 457 457
q16 485 440 431 431
q17 1854 1647 1638 1638
q18 8364 7897 7832 7832
q19 1685 1483 1593 1483
q20 2059 1881 1865 1865
q21 5233 4970 4945 4945
q22 1130 1038 1006 1006
Total cold run time: 67114 ms
Total hot run time: 58788 ms
TPC-DS: Total hot run time: 196236 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d1ec3eaac72b648f6534838fc96be69dc9b63d31, data reload: false
query1 1294 905 897 897
query2 6283 1930 1838 1838
query3 10842 4240 4426 4240
query4 60958 29702 23337 23337
query5 5254 461 462 461
query6 383 167 172 167
query7 5412 313 301 301
query8 311 228 219 219
query9 8437 2596 2584 2584
query10 457 266 259 259
query11 17971 15446 15709 15446
query12 158 104 104 104
query13 1453 464 460 460
query14 9697 6733 7372 6733
query15 194 176 176 176
query16 7178 428 470 428
query17 1286 585 606 585
query18 1861 322 316 316
query19 207 154 161 154
query20 123 108 110 108
query21 218 108 105 105
query22 4713 4486 4843 4486
query23 34719 33919 34345 33919
query24 6205 2884 2887 2884
query25 544 414 419 414
query26 653 167 172 167
query27 1941 364 358 358
query28 4210 2197 2121 2121
query29 709 488 431 431
query30 236 158 157 157
query31 990 821 821 821
query32 70 62 60 60
query33 417 294 307 294
query34 938 529 533 529
query35 865 734 725 725
query36 1066 934 956 934
query37 114 64 69 64
query38 3996 3973 3921 3921
query39 1499 1474 1454 1454
query40 213 100 96 96
query41 48 47 47 47
query42 110 102 98 98
query43 520 466 468 466
query44 1161 829 858 829
query45 187 175 168 168
query46 1160 738 713 713
query47 2039 1941 1965 1941
query48 467 386 399 386
query49 723 398 406 398
query50 829 422 426 422
query51 7440 7405 7337 7337
query52 103 89 91 89
query53 260 181 182 181
query54 560 463 468 463
query55 75 76 79 76
query56 266 242 252 242
query57 1306 1241 1219 1219
query58 228 211 214 211
query59 3122 2854 3062 2854
query60 288 261 254 254
query61 108 111 114 111
query62 809 672 695 672
query63 230 198 189 189
query64 2010 683 675 675
query65 3269 3195 3186 3186
query66 733 295 289 289
query67 16068 15622 15542 15542
query68 4158 586 582 582
query69 424 277 269 269
query70 1138 1075 1106 1075
query71 329 250 244 244
query72 6358 4050 4134 4050
query73 749 343 357 343
query74 10536 8975 9282 8975
query75 3351 2638 2703 2638
query76 2038 1092 1046 1046
query77 507 295 266 266
query78 10679 9617 9613 9613
query79 2046 592 614 592
query80 1302 415 424 415
query81 522 220 216 216
query82 1053 88 84 84
query83 164 142 145 142
query84 278 79 76 76
query85 971 307 286 286
query86 367 297 284 284
query87 4423 4168 4174 4168
query88 3542 2389 2387 2387
query89 417 293 290 290
query90 2008 186 180 180
query91 203 148 147 147
query92 61 48 49 48
query93 2581 556 559 556
query94 783 286 290 286
query95 355 259 248 248
query96 615 284 284 284
query97 3306 3147 3150 3147
query98 209 204 191 191
query99 1594 1297 1302 1297
Total cold run time: 315261 ms
Total hot run time: 196236 ms
TPC-H: Total hot run time: 39784 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e8d3b59fd6125821fa40b7aa2de7fbc390f940e6, data reload: false
------ Round 1 ----------------------------------
q1 17690 6937 6574 6574
q2 2071 175 173 173
q3 10697 1086 1174 1086
q4 10558 738 703 703
q5 7763 2896 2870 2870
q6 218 138 140 138
q7 1009 614 608 608
q8 9337 1906 2052 1906
q9 6651 6425 6396 6396
q10 6967 2293 2290 2290
q11 458 262 264 262
q12 404 213 206 206
q13 17842 2981 3028 2981
q14 246 201 205 201
q15 504 461 469 461
q16 472 397 395 395
q17 986 593 573 573
q18 7291 6766 6602 6602
q19 1396 1055 1060 1055
q20 492 201 200 200
q21 4105 3277 3125 3125
q22 1084 988 979 979
Total cold run time: 108241 ms
Total hot run time: 39784 ms
----- Round 2, with runtime_filter_mode=off -----
q1 6555 6547 6617 6547
q2 329 229 230 229
q3 2914 2763 2914 2763
q4 2076 1799 1792 1792
q5 5743 5760 5794 5760
q6 216 131 134 131
q7 2205 1785 1831 1785
q8 3381 3559 3535 3535
q9 8961 8795 8905 8795
q10 3581 3524 3514 3514
q11 614 489 489 489
q12 798 597 615 597
q13 7955 3164 3188 3164
q14 298 276 260 260
q15 510 470 455 455
q16 488 435 449 435
q17 1836 1624 1608 1608
q18 8344 7914 7744 7744
q19 1705 1552 1551 1551
q20 2133 1819 1799 1799
q21 5044 4968 4967 4967
q22 1140 974 1060 974
Total cold run time: 66826 ms
Total hot run time: 58894 ms
TPC-DS: Total hot run time: 196793 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e8d3b59fd6125821fa40b7aa2de7fbc390f940e6, data reload: false
query1 1275 904 882 882
query2 6322 1892 1855 1855
query3 10799 4375 4338 4338
query4 61520 29019 23881 23881
query5 5203 449 434 434
query6 404 173 194 173
query7 5501 314 313 313
query8 308 218 213 213
query9 8622 2580 2578 2578
query10 463 274 255 255
query11 17408 15204 15644 15204
query12 169 102 109 102
query13 1467 438 429 429
query14 10010 7318 7074 7074
query15 201 183 171 171
query16 7140 509 441 441
query17 1150 572 574 572
query18 1938 300 305 300
query19 199 154 155 154
query20 119 108 110 108
query21 198 102 105 102
query22 4725 4537 4644 4537
query23 34401 33677 34368 33677
query24 6221 2964 2879 2879
query25 506 390 403 390
query26 664 171 165 165
query27 1953 359 363 359
query28 4128 2193 2169 2169
query29 708 458 459 458
query30 231 154 158 154
query31 1028 845 828 828
query32 75 55 57 55
query33 469 325 305 305
query34 911 509 526 509
query35 896 717 713 713
query36 1085 955 951 951
query37 116 73 71 71
query38 3978 3949 3968 3949
query39 1530 1456 1450 1450
query40 201 107 108 107
query41 53 51 52 51
query42 123 103 102 102
query43 518 461 483 461
query44 1208 833 824 824
query45 189 174 175 174
query46 1155 740 758 740
query47 2014 1939 1956 1939
query48 486 388 390 388
query49 756 441 425 425
query50 842 431 423 423
query51 7489 7419 7328 7328
query52 106 98 88 88
query53 259 190 186 186
query54 587 466 470 466
query55 80 75 87 75
query56 283 258 254 254
query57 1315 1223 1184 1184
query58 215 221 211 211
query59 3192 2947 3094 2947
query60 286 259 256 256
query61 114 106 138 106
query62 767 648 638 638
query63 212 180 184 180
query64 1864 672 643 643
query65 3278 3165 3181 3165
query66 728 293 298 293
query67 16017 15464 15523 15464
query68 4085 601 583 583
query69 429 259 257 257
query70 1153 1082 1110 1082
query71 335 253 250 250
query72 6363 4009 4135 4009
query73 755 353 366 353
query74 10512 9234 9170 9170
query75 3377 2701 2663 2663
query76 2030 1142 1105 1105
query77 466 288 266 266
query78 10516 9483 9582 9483
query79 1730 597 579 579
query80 855 429 423 423
query81 506 218 217 217
query82 179 86 88 86
query83 162 147 145 145
query84 286 79 76 76
query85 935 305 293 293
query86 370 293 301 293
query87 4328 4210 4140 4140
query88 4639 2364 2330 2330
query89 396 291 286 286
query90 2038 181 181 181
query91 180 148 143 143
query92 62 50 50 50
query93 1921 561 558 558
query94 794 273 276 273
query95 353 259 250 250
query96 610 281 274 274
query97 3302 3168 3153 3153
query98 211 209 195 195
query99 1511 1311 1347 1311
Total cold run time: 313767 ms
Total hot run time: 196793 ms
ClickBench: Total hot run time: 29.27 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e8d3b59fd6125821fa40b7aa2de7fbc390f940e6, data reload: false
query1 0.04 0.03 0.03
query2 0.07 0.03 0.03
query3 0.23 0.06 0.06
query4 1.63 0.10 0.10
query5 0.54 0.54 0.51
query6 1.14 0.74 0.73
query7 0.02 0.02 0.01
query8 0.04 0.03 0.03
query9 0.56 0.51 0.49
query10 0.55 0.56 0.57
query11 0.15 0.10 0.10
query12 0.13 0.11 0.10
query13 0.60 0.59 0.61
query14 0.76 0.83 0.79
query15 0.85 0.82 0.82
query16 0.40 0.37 0.40
query17 1.07 1.01 1.00
query18 0.23 0.21 0.22
query19 1.97 1.89 1.82
query20 0.01 0.01 0.00
query21 15.42 0.60 0.57
query22 2.67 2.06 1.62
query23 17.05 1.00 0.79
query24 3.67 0.90 0.46
query25 0.27 0.25 0.06
query26 0.35 0.14 0.13
query27 0.05 0.05 0.04
query28 10.68 0.50 0.44
query29 12.61 3.24 3.23
query30 0.26 0.06 0.06
query31 2.84 0.38 0.38
query32 3.27 0.45 0.45
query33 2.99 3.03 3.00
query34 17.13 4.46 4.41
query35 4.51 4.49 4.51
query36 0.64 0.48 0.48
query37 0.08 0.06 0.07
query38 0.05 0.04 0.04
query39 0.03 0.02 0.02
query40 0.16 0.12 0.12
query41 0.08 0.02 0.02
query42 0.03 0.03 0.02
query43 0.04 0.03 0.03
Total cold run time: 105.87 s
Total hot run time: 29.27 s