doris
doris copied to clipboard
Published
20 hours ago •
apache
apache
[Enhancement] (nereids) optimize CancelWarmUpJobCommand and remove CancelCloudWarmUpStmt
What problem does this PR solve?
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
Release note
None
Check List (For Author)
-
Test
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
-
Behavior changed:
- [ ] No.
- [ ] Yes.
-
Does this need documentation?
- [ ] No.
- [ ] Yes.
Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
- What problem was fixed (it's best to include specific error reporting information). How it was fixed.
- Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
- What features were added. Why was this function added?
- Which code was refactored and why was this part of the code refactored?
- Which functions were optimized and what is the difference before and after the optimization?
TPC-H: Total hot run time: 34551 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c75b516b05e7f1b3acee910ca0546906b3a98ebe, data reload: false
------ Round 1 ----------------------------------
q1 17614 5320 5154 5154
q2 1961 284 169 169
q3 10321 1295 800 800
q4 10235 1029 517 517
q5 7790 2417 2456 2417
q6 199 170 136 136
q7 940 775 607 607
q8 9341 1550 1232 1232
q9 6995 5301 5318 5301
q10 6958 2376 1978 1978
q11 512 289 290 289
q12 362 361 217 217
q13 17769 3704 3089 3089
q14 240 231 218 218
q15 572 488 492 488
q16 433 434 371 371
q17 617 908 361 361
q18 7507 7196 7030 7030
q19 1392 1041 590 590
q20 333 345 225 225
q21 3864 3235 2377 2377
q22 1080 1056 985 985
Total cold run time: 107035 ms
Total hot run time: 34551 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5334 5267 5330 5267
q2 246 322 224 224
q3 2163 2698 2256 2256
q4 1382 1813 1375 1375
q5 4227 4319 4403 4319
q6 236 173 130 130
q7 2081 1981 1784 1784
q8 2732 2772 2702 2702
q9 7292 7452 7447 7447
q10 3104 3326 2915 2915
q11 596 530 495 495
q12 735 823 679 679
q13 3766 3973 3257 3257
q14 306 304 276 276
q15 567 510 513 510
q16 465 485 456 456
q17 1215 1756 1373 1373
q18 7814 7520 7533 7520
q19 891 843 921 843
q20 2001 2067 1944 1944
q21 4910 4444 4482 4444
q22 1116 1091 1034 1034
Total cold run time: 53179 ms
Total hot run time: 51250 ms
TPC-DS: Total hot run time: 193842 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c75b516b05e7f1b3acee910ca0546906b3a98ebe, data reload: false
query1 1384 1006 1023 1006
query2 6233 1861 1858 1858
query3 11149 4595 4400 4400
query4 54145 25058 23391 23391
query5 5212 535 471 471
query6 343 216 200 200
query7 4878 520 288 288
query8 297 232 231 231
query9 5561 2699 2709 2699
query10 448 339 275 275
query11 15072 15189 14872 14872
query12 158 109 104 104
query13 1030 516 397 397
query14 10194 6466 6490 6466
query15 207 204 179 179
query16 7145 669 543 543
query17 1113 762 611 611
query18 1613 455 342 342
query19 210 204 182 182
query20 145 128 127 127
query21 225 127 115 115
query22 4345 4383 4282 4282
query23 34435 33699 33753 33699
query24 6536 2421 2415 2415
query25 471 484 402 402
query26 716 295 156 156
query27 2299 528 355 355
query28 2870 2196 2230 2196
query29 582 550 422 422
query30 277 226 196 196
query31 893 864 782 782
query32 72 65 60 60
query33 444 362 332 332
query34 809 891 551 551
query35 811 846 757 757
query36 952 992 890 890
query37 114 108 79 79
query38 4278 4287 4231 4231
query39 1558 1472 1483 1472
query40 210 122 116 116
query41 62 61 57 57
query42 137 112 112 112
query43 522 519 477 477
query44 1325 855 844 844
query45 184 175 169 169
query46 864 1040 661 661
query47 1840 1859 1811 1811
query48 390 445 346 346
query49 667 493 404 404
query50 681 710 430 430
query51 4186 4264 4233 4233
query52 109 110 107 107
query53 225 256 185 185
query54 598 599 540 540
query55 86 88 87 87
query56 314 312 331 312
query57 1236 1244 1175 1175
query58 267 293 257 257
query59 2716 2811 2734 2734
query60 332 322 301 301
query61 126 120 123 120
query62 764 752 672 672
query63 229 204 196 196
query64 1919 1101 719 719
query65 4367 4179 4202 4179
query66 735 423 352 352
query67 15988 15549 15635 15549
query68 6896 907 537 537
query69 546 320 260 260
query70 1242 1105 1090 1090
query71 512 320 303 303
query72 5480 4735 4806 4735
query73 1463 625 357 357
query74 9037 9318 8944 8944
query75 3958 3204 2732 2732
query76 4293 1208 774 774
query77 667 436 295 295
query78 10090 10281 9473 9473
query79 1635 828 561 561
query80 791 517 428 428
query81 493 263 215 215
query82 411 127 101 101
query83 324 267 234 234
query84 287 110 81 81
query85 793 345 305 305
query86 336 312 283 283
query87 4496 4477 4376 4376
query88 2898 2237 2251 2237
query89 395 319 289 289
query90 1948 207 209 207
query91 141 136 109 109
query92 73 59 57 57
query93 1335 965 592 592
query94 693 411 318 318
query95 373 298 289 289
query96 512 575 280 280
query97 2752 2742 2732 2732
query98 227 208 205 205
query99 1456 1389 1264 1264
Total cold run time: 296856 ms
Total hot run time: 193842 ms
ClickBench: Total hot run time: 29.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c75b516b05e7f1b3acee910ca0546906b3a98ebe, data reload: false
query1 0.04 0.03 0.02
query2 0.07 0.04 0.03
query3 0.24 0.07 0.07
query4 1.60 0.10 0.11
query5 0.44 0.42 0.43
query6 1.17 0.66 0.67
query7 0.02 0.02 0.02
query8 0.04 0.03 0.04
query9 0.57 0.51 0.51
query10 0.56 0.58 0.57
query11 0.16 0.11 0.11
query12 0.16 0.12 0.12
query13 0.62 0.61 0.60
query14 0.82 0.81 0.81
query15 0.88 0.87 0.88
query16 0.39 0.38 0.38
query17 1.04 1.09 1.07
query18 0.23 0.21 0.22
query19 1.93 1.85 1.91
query20 0.02 0.01 0.01
query21 15.45 0.94 0.54
query22 0.77 1.13 0.60
query23 15.01 1.37 0.64
query24 7.59 1.71 0.49
query25 0.47 0.20 0.14
query26 0.53 0.16 0.15
query27 0.07 0.06 0.05
query28 9.74 0.86 0.46
query29 12.55 4.00 3.37
query30 0.26 0.10 0.08
query31 2.82 0.61 0.41
query32 3.23 0.55 0.47
query33 3.02 3.06 3.07
query34 16.10 5.41 4.79
query35 4.90 4.79 4.81
query36 0.68 0.49 0.49
query37 0.09 0.07 0.06
query38 0.05 0.04 0.04
query39 0.04 0.03 0.03
query40 0.17 0.15 0.14
query41 0.09 0.03 0.02
query42 0.04 0.03 0.02
query43 0.04 0.04 0.03
Total cold run time: 104.71 s
Total hot run time: 29.33 s
FE UT Coverage Report
Increment line coverage 0.00% (0/4) :tada:
Increment coverage report
Complete coverage report
TPC-H: Total hot run time: 33821 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9a6fbb8063bfc82d93543294adfbb50f3826fd85, data reload: false
------ Round 1 ----------------------------------
q1 17574 5267 4996 4996
q2 1946 293 187 187
q3 10287 1436 718 718
q4 10203 1034 515 515
q5 7542 2333 2306 2306
q6 177 158 130 130
q7 898 739 618 618
q8 9319 1298 1135 1135
q9 6722 5082 5131 5082
q10 6880 2399 2015 2015
q11 489 279 266 266
q12 342 342 212 212
q13 17756 3660 3024 3024
q14 225 237 222 222
q15 563 483 500 483
q16 429 444 372 372
q17 600 843 353 353
q18 7771 7320 7103 7103
q19 1792 946 566 566
q20 336 343 217 217
q21 3751 2597 2329 2329
q22 1067 1038 972 972
Total cold run time: 106669 ms
Total hot run time: 33821 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5155 5045 5073 5045
q2 243 319 226 226
q3 2176 2644 2319 2319
q4 1336 1801 1350 1350
q5 4229 4133 4445 4133
q6 217 176 134 134
q7 2022 1934 1818 1818
q8 2607 2614 2567 2567
q9 7129 7189 7226 7189
q10 3077 3280 2807 2807
q11 598 529 508 508
q12 709 767 623 623
q13 3409 3923 3277 3277
q14 297 289 269 269
q15 543 509 508 508
q16 447 481 449 449
q17 1119 1536 1369 1369
q18 7741 7542 7415 7415
q19 850 841 858 841
q20 1955 2018 1870 1870
q21 4893 4491 4356 4356
q22 1079 1027 1014 1014
Total cold run time: 51831 ms
Total hot run time: 50087 ms
TPC-DS: Total hot run time: 185865 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9a6fbb8063bfc82d93543294adfbb50f3826fd85, data reload: false
query1 996 394 386 386
query2 6549 1842 1814 1814
query3 6752 221 220 220
query4 26940 23656 23444 23444
query5 4292 619 453 453
query6 322 235 202 202
query7 4627 485 291 291
query8 273 234 218 218
query9 8652 2685 2696 2685
query10 466 348 283 283
query11 15349 15122 14864 14864
query12 165 108 109 108
query13 1653 553 403 403
query14 9305 6187 6107 6107
query15 198 196 191 191
query16 7299 673 459 459
query17 1183 726 547 547
query18 1985 402 298 298
query19 187 199 154 154
query20 118 114 115 114
query21 222 126 109 109
query22 4041 4227 4066 4066
query23 34089 33046 33200 33046
query24 8402 2385 2389 2385
query25 539 464 388 388
query26 1230 274 151 151
query27 2758 502 348 348
query28 4331 2159 2140 2140
query29 753 552 430 430
query30 285 221 196 196
query31 962 832 756 756
query32 75 62 60 60
query33 567 360 305 305
query34 803 848 534 534
query35 796 800 727 727
query36 972 989 870 870
query37 113 97 81 81
query38 4094 4127 3943 3943
query39 1469 1436 1382 1382
query40 206 124 111 111
query41 62 60 58 58
query42 126 114 108 108
query43 501 508 473 473
query44 1307 811 809 809
query45 175 174 162 162
query46 839 1029 635 635
query47 1717 1773 1686 1686
query48 398 430 306 306
query49 739 472 405 405
query50 635 701 403 403
query51 4170 4172 4172 4172
query52 108 106 99 99
query53 235 260 179 179
query54 585 582 500 500
query55 86 82 80 80
query56 296 283 283 283
query57 1203 1193 1115 1115
query58 267 249 255 249
query59 2644 2702 2664 2664
query60 329 310 302 302
query61 125 121 132 121
query62 817 727 653 653
query63 219 184 184 184
query64 4311 1102 773 773
query65 4249 4186 4173 4173
query66 1147 419 313 313
query67 15713 15790 15356 15356
query68 7931 900 531 531
query69 458 312 266 266
query70 1182 1089 1136 1089
query71 489 323 319 319
query72 5340 4721 4804 4721
query73 710 631 353 353
query74 9172 8917 8996 8917
query75 3790 3192 2684 2684
query76 3664 1181 753 753
query77 789 391 289 289
query78 10012 10111 9389 9389
query79 3019 819 588 588
query80 618 504 445 445
query81 464 262 222 222
query82 470 124 97 97
query83 292 251 228 228
query84 289 112 88 88
query85 784 349 309 309
query86 331 298 289 289
query87 4385 4428 4307 4307
query88 3033 2261 2272 2261
query89 427 323 281 281
query90 1922 204 204 204
query91 144 146 110 110
query92 73 62 58 58
query93 2087 960 582 582
query94 662 423 298 298
query95 368 289 277 277
query96 560 572 279 279
query97 2733 2738 2612 2612
query98 246 205 197 197
query99 1451 1402 1292 1292
Total cold run time: 274916 ms
Total hot run time: 185865 ms
ClickBench: Total hot run time: 29.35 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9a6fbb8063bfc82d93543294adfbb50f3826fd85, data reload: false
query1 0.03 0.03 0.03
query2 0.07 0.03 0.04
query3 0.24 0.07 0.06
query4 1.62 0.10 0.10
query5 0.43 0.42 0.41
query6 1.17 0.66 0.66
query7 0.03 0.01 0.01
query8 0.04 0.04 0.04
query9 0.58 0.52 0.52
query10 0.57 0.58 0.56
query11 0.15 0.11 0.12
query12 0.15 0.11 0.12
query13 0.63 0.61 0.60
query14 0.85 0.80 0.85
query15 0.88 0.86 0.86
query16 0.40 0.38 0.38
query17 1.03 1.06 1.06
query18 0.23 0.21 0.20
query19 1.89 1.90 1.82
query20 0.01 0.02 0.01
query21 15.39 0.88 0.56
query22 0.76 1.13 0.77
query23 14.90 1.39 0.62
query24 7.46 1.02 0.41
query25 0.54 0.19 0.12
query26 0.61 0.17 0.14
query27 0.07 0.05 0.06
query28 9.34 0.92 0.45
query29 12.63 3.98 3.32
query30 0.25 0.09 0.06
query31 2.82 0.61 0.39
query32 3.24 0.55 0.47
query33 3.02 3.12 3.13
query34 16.05 5.42 4.82
query35 4.89 4.90 4.86
query36 0.68 0.49 0.49
query37 0.08 0.06 0.06
query38 0.05 0.04 0.03
query39 0.03 0.02 0.02
query40 0.17 0.14 0.15
query41 0.09 0.03 0.03
query42 0.04 0.02 0.02
query43 0.04 0.04 0.03
Total cold run time: 104.15 s
Total hot run time: 29.35 s
FE UT Coverage Report
Increment line coverage 0.00% (0/4) :tada:
Increment coverage report
Complete coverage report
FE UT Coverage Report
Increment line coverage 0.00% (0/4) :tada:
Increment coverage report
Complete coverage report
TPC-H: Total hot run time: 34514 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7d7ead621d33d845238317e8009232a0b4f8bb63, data reload: false
------ Round 1 ----------------------------------
q1 17593 5131 4982 4982
q2 1928 287 190 190
q3 10299 1293 710 710
q4 10211 1001 558 558
q5 7546 2317 2396 2317
q6 177 163 131 131
q7 892 758 599 599
q8 9318 1300 1140 1140
q9 6809 5092 5121 5092
q10 6908 2384 1988 1988
q11 491 298 288 288
q12 345 347 220 220
q13 17768 3713 3062 3062
q14 229 233 212 212
q15 563 491 479 479
q16 431 426 378 378
q17 612 889 381 381
q18 7573 7123 7016 7016
q19 1421 938 552 552
q20 346 341 231 231
q21 3998 3216 3015 3015
q22 1031 1037 973 973
Total cold run time: 106489 ms
Total hot run time: 34514 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5065 5008 5020 5008
q2 240 330 219 219
q3 2131 2669 2319 2319
q4 1357 1789 1384 1384
q5 4235 4079 4356 4079
q6 209 173 129 129
q7 1976 1914 1731 1731
q8 2652 2609 2537 2537
q9 7112 6960 7122 6960
q10 3092 3312 2868 2868
q11 605 508 510 508
q12 681 790 593 593
q13 3667 3993 3278 3278
q14 286 296 277 277
q15 518 494 469 469
q16 442 473 444 444
q17 1177 1521 1380 1380
q18 7307 7059 7209 7059
q19 775 782 1007 782
q20 1937 1962 1828 1828
q21 4965 4407 4368 4368
q22 1083 1035 988 988
Total cold run time: 51512 ms
Total hot run time: 49208 ms
TPC-DS: Total hot run time: 186534 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7d7ead621d33d845238317e8009232a0b4f8bb63, data reload: false
query1 1002 399 406 399
query2 6542 1812 1831 1812
query3 6742 237 227 227
query4 26491 23860 23530 23530
query5 4332 641 485 485
query6 306 213 192 192
query7 4619 481 279 279
query8 257 213 207 207
query9 8610 2612 2633 2612
query10 488 351 284 284
query11 15688 15126 14863 14863
query12 166 113 108 108
query13 1672 544 434 434
query14 9474 6326 6164 6164
query15 210 196 176 176
query16 7294 665 475 475
query17 1203 755 581 581
query18 2005 432 317 317
query19 195 196 167 167
query20 131 128 124 124
query21 226 129 120 120
query22 3997 4200 4009 4009
query23 34035 33116 33151 33116
query24 8574 2434 2439 2434
query25 533 457 402 402
query26 1242 273 154 154
query27 2722 505 347 347
query28 4265 2107 2105 2105
query29 750 575 429 429
query30 287 224 188 188
query31 946 874 792 792
query32 113 64 63 63
query33 553 386 315 315
query34 818 841 548 548
query35 792 806 731 731
query36 958 976 890 890
query37 116 98 75 75
query38 4179 4185 4133 4133
query39 1468 1414 1424 1414
query40 206 120 104 104
query41 65 61 79 61
query42 122 111 105 105
query43 502 500 471 471
query44 1361 838 835 835
query45 189 175 168 168
query46 885 1015 630 630
query47 1766 1785 1730 1730
query48 388 417 322 322
query49 760 488 394 394
query50 670 685 408 408
query51 4098 4113 4212 4113
query52 113 111 101 101
query53 229 251 186 186
query54 585 579 503 503
query55 86 85 84 84
query56 315 315 292 292
query57 1220 1198 1142 1142
query58 271 263 261 261
query59 2644 2698 2599 2599
query60 334 318 315 315
query61 132 125 124 124
query62 822 737 642 642
query63 234 194 186 186
query64 4319 995 722 722
query65 4252 4137 4152 4137
query66 1131 415 317 317
query67 15971 15803 15353 15353
query68 8176 925 540 540
query69 471 307 268 268
query70 1233 1125 1125 1125
query71 475 341 307 307
query72 5501 4724 4947 4724
query73 744 694 357 357
query74 9326 9216 8658 8658
query75 3811 3211 2730 2730
query76 4405 1218 791 791
query77 791 412 291 291
query78 10360 10310 9458 9458
query79 2139 820 620 620
query80 585 605 459 459
query81 506 258 230 230
query82 481 126 100 100
query83 253 248 242 242
query84 254 108 96 96
query85 823 359 310 310
query86 389 305 273 273
query87 4521 4404 4442 4404
query88 3564 2290 2335 2290
query89 388 327 293 293
query90 1911 210 208 208
query91 142 148 109 109
query92 77 59 56 56
query93 1633 981 593 593
query94 684 413 316 316
query95 380 292 284 284
query96 494 570 282 282
query97 2738 2758 2655 2655
query98 237 220 209 209
query99 1350 1408 1250 1250
Total cold run time: 276513 ms
Total hot run time: 186534 ms
ClickBench: Total hot run time: 29.13 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7d7ead621d33d845238317e8009232a0b4f8bb63, data reload: false
query1 0.04 0.03 0.03
query2 0.08 0.03 0.04
query3 0.25 0.07 0.06
query4 1.61 0.10 0.11
query5 0.45 0.43 0.43
query6 1.17 0.68 0.67
query7 0.03 0.02 0.02
query8 0.05 0.03 0.03
query9 0.58 0.52 0.51
query10 0.58 0.60 0.58
query11 0.16 0.12 0.11
query12 0.15 0.12 0.13
query13 0.63 0.61 0.61
query14 0.82 0.81 0.84
query15 0.90 0.87 0.89
query16 0.39 0.38 0.38
query17 1.10 1.12 1.06
query18 0.23 0.21 0.21
query19 1.96 1.85 1.92
query20 0.02 0.01 0.01
query21 15.44 0.91 0.54
query22 0.77 1.25 0.67
query23 14.87 1.39 0.65
query24 7.12 1.83 0.31
query25 0.29 0.08 0.15
query26 0.63 0.17 0.14
query27 0.08 0.06 0.05
query28 10.02 0.93 0.46
query29 12.52 3.93 3.31
query30 0.26 0.09 0.08
query31 2.82 0.59 0.40
query32 3.25 0.56 0.46
query33 3.09 3.12 3.07
query34 16.15 5.39 4.80
query35 4.84 4.85 4.80
query36 0.70 0.52 0.50
query37 0.10 0.06 0.06
query38 0.05 0.04 0.03
query39 0.03 0.03 0.02
query40 0.18 0.14 0.14
query41 0.08 0.03 0.02
query42 0.03 0.02 0.03
query43 0.04 0.03 0.03
Total cold run time: 104.56 s
Total hot run time: 29.13 s
PR approved by at least one committer and no changes requested.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}