doris
doris copied to clipboard
apache
[only-for-debug-test] time sharing task executor timeout test.
What problem does this PR solve?
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
Release note
None
Check List (For Author)
-
Test
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
-
Behavior changed:
- [ ] No.
- [ ] Yes.
-
Does this need documentation?
- [ ] No.
- [ ] Yes.
Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.
Please clearly describe your PR:
- What problem was fixed (it's best to include specific error reporting information). How it was fixed.
- Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
- What features were added. Why was this function added?
- Which code was refactored and why was this part of the code refactored?
- Which functions were optimized and what is the difference before and after the optimization?
TPC-H: Total hot run time: 34076 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4fab5453ab5dddd7f5f7cfc6eaeea975af002f91, data reload: false
------ Round 1 ----------------------------------
q1 17664 5011 4848 4848
q2 2038 340 215 215
q3 10289 1278 699 699
q4 10261 923 369 369
q5 7503 2383 2267 2267
q6 182 164 134 134
q7 885 730 626 626
q8 9365 1341 1152 1152
q9 7138 5333 5336 5333
q10 6805 2195 1826 1826
q11 487 302 269 269
q12 331 359 226 226
q13 17827 3626 3069 3069
q14 235 239 223 223
q15 558 505 506 505
q16 1023 1000 943 943
q17 575 861 362 362
q18 7533 7082 7015 7015
q19 1237 961 547 547
q20 360 345 247 247
q21 3823 3166 2245 2245
q22 1033 981 956 956
Total cold run time: 107152 ms
Total hot run time: 34076 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4824 5015 4822 4822
q2 328 406 319 319
q3 2166 2713 2318 2318
q4 1341 1736 1285 1285
q5 4162 4327 4574 4327
q6 217 185 140 140
q7 2054 1956 1969 1956
q8 2661 2453 2476 2453
q9 7646 7539 7593 7539
q10 2998 3199 2874 2874
q11 620 524 525 524
q12 717 785 682 682
q13 3592 3898 3379 3379
q14 304 311 284 284
q15 564 499 506 499
q16 1092 1123 1069 1069
q17 1143 1563 1386 1386
q18 7832 7717 7616 7616
q19 763 824 851 824
q20 1975 2043 1976 1976
q21 5054 4354 4165 4165
q22 1080 1033 998 998
Total cold run time: 53133 ms
Total hot run time: 51435 ms
ClickBench: Total hot run time: 27.91 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4fab5453ab5dddd7f5f7cfc6eaeea975af002f91, data reload: false
query1 0.06 0.05 0.04
query2 0.09 0.06 0.05
query3 0.26 0.08 0.09
query4 1.60 0.12 0.11
query5 0.27 0.25 0.24
query6 1.17 0.66 0.64
query7 0.04 0.03 0.02
query8 0.06 0.04 0.05
query9 0.57 0.51 0.52
query10 0.59 0.57 0.57
query11 0.17 0.12 0.11
query12 0.15 0.12 0.12
query13 0.62 0.60 0.62
query14 1.01 1.01 1.00
query15 0.85 0.82 0.85
query16 0.38 0.38 0.39
query17 1.04 1.10 1.03
query18 0.21 0.19 0.20
query19 1.95 1.80 1.82
query20 0.02 0.01 0.01
query21 15.44 0.19 0.13
query22 5.11 0.07 0.05
query23 15.67 0.26 0.10
query24 2.38 1.14 0.76
query25 0.07 0.06 0.07
query26 0.15 0.14 0.12
query27 0.06 0.06 0.06
query28 4.89 1.20 0.95
query29 12.68 3.92 3.28
query30 0.29 0.14 0.12
query31 2.82 0.57 0.40
query32 3.23 0.55 0.47
query33 3.13 3.06 3.15
query34 15.65 5.19 4.57
query35 4.59 4.60 4.64
query36 0.68 0.51 0.49
query37 0.09 0.06 0.07
query38 0.06 0.04 0.04
query39 0.04 0.03 0.02
query40 0.17 0.14 0.13
query41 0.08 0.03 0.03
query42 0.04 0.02 0.02
query43 0.05 0.03 0.03
Total cold run time: 98.48 s
Total hot run time: 27.91 s
BE UT Coverage Report
Increment line coverage 79.17% (76/96) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 52.62% (18281/34739) |
| Line Coverage | 38.07% (166407/437155) |
| Region Coverage | 33.07% (129692/392165) |
| Branch Coverage | 33.81% (55486/164124) |
TPC-H: Total hot run time: 35954 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f3cc40bfa76361b83e233aaaec04d5dd4ba69a35, data reload: false
------ Round 1 ----------------------------------
q1 17663 5007 4853 4853
q2 2057 321 210 210
q3 10248 1325 740 740
q4 10292 895 324 324
q5 7610 2451 2164 2164
q6 189 170 135 135
q7 965 777 635 635
q8 9397 1475 1094 1094
q9 7151 5355 5309 5309
q10 6821 2229 1764 1764
q11 586 319 286 286
q12 343 377 239 239
q13 17780 3661 3055 3055
q14 243 235 235 235
q15 576 522 509 509
q16 877 887 810 810
q17 702 848 458 458
q18 7525 7942 7923 7923
q19 1202 993 639 639
q20 391 372 236 236
q21 4697 4024 3277 3277
q22 1110 1062 1059 1059
Total cold run time: 108425 ms
Total hot run time: 35954 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5262 5065 5127 5065
q2 329 398 338 338
q3 2398 2836 2573 2573
q4 1423 1935 1398 1398
q5 4692 4539 4664 4539
q6 209 174 128 128
q7 2008 1988 1837 1837
q8 2661 2471 2498 2471
q9 7539 7611 7589 7589
q10 3035 3340 2846 2846
q11 597 530 493 493
q12 691 734 546 546
q13 3254 3620 3036 3036
q14 266 281 253 253
q15 528 482 487 482
q16 852 875 854 854
q17 1156 1455 1396 1396
q18 7249 7227 7048 7048
q19 859 819 845 819
q20 1916 1989 1808 1808
q21 4746 4268 4222 4222
q22 1081 1028 970 970
Total cold run time: 52751 ms
Total hot run time: 50711 ms
TPC-DS: Total hot run time: 186512 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f3cc40bfa76361b83e233aaaec04d5dd4ba69a35, data reload: false
query5 5389 800 670 670
query6 409 299 272 272
query7 4734 513 319 319
query8 355 297 278 278
query9 8870 3296 3297 3296
query10 618 443 429 429
query11 15758 14886 14938 14886
query12 243 168 168 168
query13 1738 530 414 414
query14 7842 3353 3222 3222
query14_1 3071 3027 3100 3027
query15 309 212 195 195
query16 7837 512 484 484
query17 1607 788 636 636
query18 2096 468 387 387
query19 299 227 210 210
query20 174 166 162 162
query21 223 143 121 121
query22 4035 3957 3861 3861
query23 16850 16461 15925 15925
query23_1 16025 16083 16117 16083
query24 6391 1674 1278 1278
query24_1 1250 1252 1264 1252
query25 651 569 530 530
query26 1263 307 218 218
query27 2826 486 342 342
query28 4441 2379 2336 2336
query29 826 605 511 511
query30 327 245 223 223
query31 810 701 643 643
query32 146 128 129 128
query33 704 480 448 448
query34 892 896 598 598
query35 891 867 786 786
query36 903 942 863 863
query37 181 157 148 148
query38 3988 3930 3841 3841
query39 749 761 727 727
query39_1 708 718 704 704
query40 283 187 176 176
query41 68 61 63 61
query42 178 150 148 148
query43 459 464 413 413
query44 1375 881 872 872
query45 233 222 221 221
query46 942 990 662 662
query47 1747 1768 1635 1635
query48 428 368 273 273
query49 818 552 506 506
query50 710 329 269 269
query51 3890 3900 3843 3843
query52 157 147 142 142
query53 288 277 228 228
query54 462 432 425 425
query55 149 135 128 128
query56 499 467 461 461
query57 1215 1173 1123 1123
query58 469 439 423 423
query59 2369 2386 2339 2339
query60 518 485 470 470
query61 209 203 197 197
query62 793 693 644 644
query63 272 222 223 222
query64 4656 1371 1099 1099
query65 4100 4007 3965 3965
query66 1316 523 437 437
query67 15415 15131 14823 14823
query68 7366 943 680 680
query69 603 459 432 432
query70 1170 1062 1063 1062
query71 492 413 416 413
query72 6014 4913 4895 4895
query73 705 582 346 346
query74 8583 8745 8704 8704
query75 2973 2938 2514 2514
query76 3351 1217 874 874
query77 579 521 446 446
query78 9397 9844 8913 8913
query79 1518 841 631 631
query80 783 689 616 616
query81 520 273 247 247
query82 228 169 161 161
query83 296 276 263 263
query84 270 119 99 99
query85 913 545 503 503
query86 438 351 342 342
query87 4147 4137 3920 3920
query88 3018 2325 2310 2310
query89 429 360 326 326
query90 2273 258 249 249
query91 177 176 143 143
query92 139 136 122 122
query93 1858 1074 699 699
query94 874 353 333 333
query95 671 510 497 497
query96 564 566 250 250
query97 2585 2677 2590 2590
query98 293 243 236 236
query99 1344 1380 1255 1255
Total cold run time: 274815 ms
Total hot run time: 186512 ms
ClickBench: Total hot run time: 27.2 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f3cc40bfa76361b83e233aaaec04d5dd4ba69a35, data reload: false
query1 0.05 0.05 0.05
query2 0.10 0.05 0.05
query3 0.26 0.09 0.09
query4 1.61 0.11 0.11
query5 0.27 0.25 0.25
query6 1.18 0.64 0.62
query7 0.03 0.03 0.02
query8 0.06 0.04 0.04
query9 0.57 0.50 0.50
query10 0.57 0.55 0.56
query11 0.16 0.11 0.11
query12 0.15 0.12 0.11
query13 0.62 0.61 0.61
query14 0.99 0.98 0.99
query15 0.82 0.79 0.81
query16 0.39 0.38 0.37
query17 1.05 1.01 0.99
query18 0.23 0.21 0.22
query19 1.91 1.78 1.84
query20 0.02 0.01 0.02
query21 15.44 0.32 0.14
query22 4.54 0.06 0.04
query23 16.04 0.29 0.10
query24 1.48 0.45 0.18
query25 0.09 0.11 0.06
query26 0.13 0.14 0.13
query27 0.08 0.06 0.05
query28 4.21 1.25 1.02
query29 12.56 4.10 3.20
query30 0.27 0.13 0.12
query31 2.81 0.63 0.39
query32 3.24 0.55 0.46
query33 3.06 3.03 3.05
query34 16.23 5.24 4.62
query35 4.64 4.60 4.58
query36 0.65 0.50 0.49
query37 0.11 0.07 0.06
query38 0.07 0.05 0.04
query39 0.05 0.03 0.04
query40 0.17 0.16 0.13
query41 0.08 0.03 0.04
query42 0.05 0.03 0.03
query43 0.05 0.04 0.03
Total cold run time: 97.09 s
Total hot run time: 27.2 s
BE UT Coverage Report
Increment line coverage 80.79% (122/151) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 53.35% (18712/35071) |
| Line Coverage | 39.07% (173097/443010) |
| Region Coverage | 33.81% (134707/398414) |
| Branch Coverage | 34.64% (57648/166420) |
BE Regression && UT Coverage Report
Increment line coverage 85.43% (129/151) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 72.22% (24820/34367) |
| Line Coverage | 58.94% (260837/442533) |
| Region Coverage | 53.82% (216951/403131) |
| Branch Coverage | 55.31% (92529/167295) |
BE Regression && UT Coverage Report
Increment line coverage 85.43% (129/151) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 72.23% (24824/34367) |
| Line Coverage | 58.96% (260899/442533) |
| Region Coverage | 53.86% (217145/403131) |
| Branch Coverage | 55.32% (92554/167295) |
BE Regression && UT Coverage Report
Increment line coverage 85.43% (129/151) :tada:
Increment coverage report Complete coverage report
| Category | Coverage |
|---|---|
| Function Coverage | 72.24% (24826/34367) |
| Line Coverage | 58.96% (260939/442533) |
| Region Coverage | 53.87% (217172/403131) |
| Branch Coverage | 55.33% (92561/167295) |