doris
doris copied to clipboard
Published
20 hours ago •
apache
apache
[chore](cloud) Add show hotspot tablet API on BE
Usage:
- Get all tablets {metrics} with descending order
curl beip:http_port/api/hotspot/tablet?metrics={metrics} - Get top n tablets {metrics} with descending order
curl beip:http_port/api/hotspot/tablet?metrics={metrics}&topn={n}
"metrics" must be specified, which is one of
- read_block
- write
- compaction
- num_rowsets
- num_cumu_rowsets
- num_base_rowsets
Co-authored-by: plat1ko [email protected]
TODO: Add support for local mode.
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.
TeamCity be ut coverage result: Function Coverage: 35.75% (9004/25185) Line Coverage: 27.38% (74563/272289) Region Coverage: 26.61% (38581/144991) Branch Coverage: 23.47% (19677/83830) Coverage Report: http://coverage.selectdb-in.cc/coverage/b943b56ce56732d5eca79df074647a2025a32a7d_b943b56ce56732d5eca79df074647a2025a32a7d/report/index.html
TeamCity be ut coverage result: Function Coverage: 36.27% (9231/25451) Line Coverage: 27.62% (75707/274062) Region Coverage: 26.84% (39191/146042) Branch Coverage: 23.59% (19893/84326) Coverage Report: http://coverage.selectdb-in.cc/coverage/4943c90216b417adce4ff63195ac90eb04acc7b5_4943c90216b417adce4ff63195ac90eb04acc7b5/report/index.html
TeamCity be ut coverage result: Function Coverage: 36.27% (9232/25454) Line Coverage: 27.62% (75709/274085) Region Coverage: 26.84% (39199/146054) Branch Coverage: 23.60% (19903/84330) Coverage Report: http://coverage.selectdb-in.cc/coverage/10abf21e2cc10bc7cf80fd6b60ceac4c51f13733_10abf21e2cc10bc7cf80fd6b60ceac4c51f13733/report/index.html
TPC-H: Total hot run time: 42092 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 10abf21e2cc10bc7cf80fd6b60ceac4c51f13733, data reload: false
------ Round 1 ----------------------------------
q1 17599 4406 4328 4328
q2 2024 193 198 193
q3 10458 1300 1188 1188
q4 10212 886 862 862
q5 7497 2731 2762 2731
q6 228 138 139 138
q7 982 638 611 611
q8 9228 2170 2109 2109
q9 9649 6741 6790 6741
q10 9233 3899 3833 3833
q11 452 243 242 242
q12 450 235 233 233
q13 17366 3209 3245 3209
q14 291 242 239 239
q15 506 475 477 475
q16 473 393 384 384
q17 998 712 696 696
q18 8434 7794 7778 7778
q19 7684 1571 1512 1512
q20 654 328 313 313
q21 5203 3949 4008 3949
q22 402 338 328 328
Total cold run time: 120023 ms
Total hot run time: 42092 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4646 4533 4415 4415
q2 381 280 258 258
q3 3183 3013 2727 2727
q4 1913 1636 1699 1636
q5 5501 5535 5551 5535
q6 225 128 130 128
q7 2206 1810 1852 1810
q8 3262 3409 3402 3402
q9 8651 8750 8754 8750
q10 3929 3798 3843 3798
q11 596 501 518 501
q12 812 623 633 623
q13 16495 3170 3225 3170
q14 296 284 269 269
q15 528 486 468 468
q16 509 444 424 424
q17 1787 1496 1480 1480
q18 7716 7706 7336 7336
q19 1670 1623 1486 1486
q20 1983 1812 1769 1769
q21 9365 4880 4636 4636
q22 601 535 512 512
Total cold run time: 76255 ms
Total hot run time: 55133 ms
TPC-DS: Total hot run time: 168780 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 10abf21e2cc10bc7cf80fd6b60ceac4c51f13733, data reload: false
query1 941 380 383 380
query2 6443 2523 2439 2439
query3 6649 212 208 208
query4 21755 17282 17216 17216
query5 4174 429 421 421
query6 255 160 160 160
query7 4592 315 290 290
query8 312 283 274 274
query9 8670 2427 2401 2401
query10 455 272 264 264
query11 10321 10056 10062 10056
query12 135 92 87 87
query13 1648 358 366 358
query14 9371 6348 7676 6348
query15 253 194 191 191
query16 7784 265 264 264
query17 1690 545 533 533
query18 1961 286 271 271
query19 198 152 154 152
query20 92 84 97 84
query21 198 129 133 129
query22 4148 3975 3948 3948
query23 33628 33299 33013 33013
query24 11100 2848 2877 2848
query25 585 365 356 356
query26 998 156 155 155
query27 2284 310 326 310
query28 6522 2098 2079 2079
query29 857 604 621 604
query30 249 153 154 153
query31 977 747 742 742
query32 91 54 55 54
query33 759 275 264 264
query34 966 478 474 474
query35 734 599 615 599
query36 1056 962 914 914
query37 105 66 67 66
query38 2905 2766 2775 2766
query39 855 809 790 790
query40 191 126 124 124
query41 55 51 53 51
query42 105 96 97 96
query43 586 521 545 521
query44 1178 733 743 733
query45 190 181 168 168
query46 1072 723 732 723
query47 1849 1765 1767 1765
query48 365 303 296 296
query49 860 395 409 395
query50 775 394 417 394
query51 6874 6540 6663 6540
query52 98 95 92 92
query53 354 299 299 299
query54 860 443 443 443
query55 76 75 74 74
query56 295 247 248 247
query57 1133 1023 1034 1023
query58 226 215 207 207
query59 3307 3238 2972 2972
query60 268 260 294 260
query61 91 89 90 89
query62 623 454 437 437
query63 315 327 294 294
query64 8666 2273 1719 1719
query65 3171 3118 3106 3106
query66 789 328 333 328
query67 15476 14820 14733 14733
query68 4601 547 528 528
query69 450 271 286 271
query70 1191 1123 1123 1123
query71 398 274 270 270
query72 7553 5480 2753 2753
query73 720 321 318 318
query74 5997 5613 5563 5563
query75 3339 2620 2667 2620
query76 2456 1009 970 970
query77 495 271 272 271
query78 10195 9732 9793 9732
query79 1725 510 516 510
query80 886 438 428 428
query81 520 227 215 215
query82 837 94 90 90
query83 238 170 170 170
query84 251 91 86 86
query85 1159 326 327 326
query86 424 293 323 293
query87 3272 3122 3084 3084
query88 3276 2353 2336 2336
query89 471 412 388 388
query90 2013 189 190 189
query91 125 99 96 96
query92 56 50 51 50
query93 1686 498 492 492
query94 1223 192 187 187
query95 399 308 308 308
query96 590 267 264 264
query97 3172 3016 2988 2988
query98 248 221 218 218
query99 1126 858 853 853
Total cold run time: 267656 ms
Total hot run time: 168780 ms
ClickBench: Total hot run time: 31.2 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 10abf21e2cc10bc7cf80fd6b60ceac4c51f13733, data reload: false
query1 0.04 0.04 0.03
query2 0.08 0.04 0.04
query3 0.23 0.05 0.05
query4 1.67 0.07 0.07
query5 0.50 0.47 0.51
query6 1.13 0.73 0.73
query7 0.02 0.01 0.01
query8 0.05 0.04 0.04
query9 0.54 0.50 0.49
query10 0.55 0.55 0.55
query11 0.16 0.12 0.11
query12 0.15 0.11 0.11
query13 0.60 0.59 0.60
query14 0.80 0.78 0.78
query15 0.82 0.82 0.82
query16 0.37 0.35 0.37
query17 1.02 0.99 0.99
query18 0.23 0.24 0.25
query19 1.77 1.71 1.71
query20 0.01 0.01 0.01
query21 15.47 0.72 0.68
query22 3.94 6.91 2.36
query23 18.23 1.37 1.41
query24 1.50 0.35 0.24
query25 0.14 0.09 0.08
query26 0.27 0.16 0.17
query27 0.08 0.08 0.08
query28 13.33 1.02 0.98
query29 13.25 3.35 3.34
query30 0.23 0.06 0.06
query31 2.86 0.41 0.41
query32 3.26 0.47 0.46
query33 2.93 2.99 2.84
query34 17.01 4.45 4.44
query35 4.51 4.48 4.60
query36 0.65 0.46 0.46
query37 0.18 0.16 0.15
query38 0.16 0.14 0.14
query39 0.05 0.03 0.03
query40 0.16 0.14 0.13
query41 0.09 0.05 0.05
query42 0.06 0.05 0.04
query43 0.04 0.03 0.04
Total cold run time: 109.14 s
Total hot run time: 31.2 s
TeamCity be ut coverage result: Function Coverage: 36.25% (9234/25470) Line Coverage: 27.62% (75742/274198) Region Coverage: 26.84% (39214/146105) Branch Coverage: 23.58% (19897/84364) Coverage Report: http://coverage.selectdb-in.cc/coverage/10abf21e2cc10bc7cf80fd6b60ceac4c51f13733_10abf21e2cc10bc7cf80fd6b60ceac4c51f13733/report/index.html
TPC-H: Total hot run time: 40798 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 10abf21e2cc10bc7cf80fd6b60ceac4c51f13733, data reload: false
------ Round 1 ----------------------------------
q1 17593 4381 4246 4246
q2 2030 200 190 190
q3 10443 1235 1104 1104
q4 10191 813 842 813
q5 7495 2717 2748 2717
q6 228 135 138 135
q7 991 642 633 633
q8 9226 2173 2138 2138
q9 9440 6802 6693 6693
q10 9870 3877 3940 3877
q11 451 245 237 237
q12 459 278 237 237
q13 18830 3297 3035 3035
q14 294 231 219 219
q15 517 485 489 485
q16 534 403 401 401
q17 1012 660 626 626
q18 8434 7972 7792 7792
q19 6820 1509 1294 1294
q20 660 317 325 317
q21 5149 3979 3281 3281
q22 385 328 333 328
Total cold run time: 121052 ms
Total hot run time: 40798 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4542 4399 4410 4399
q2 384 263 259 259
q3 3191 2962 2830 2830
q4 1896 1597 1600 1597
q5 5525 5533 5512 5512
q6 224 128 127 127
q7 2171 1819 1811 1811
q8 3249 3417 3420 3417
q9 8611 8649 8725 8649
q10 4063 3940 3729 3729
q11 576 494 474 474
q12 775 577 607 577
q13 16860 3103 3089 3089
q14 316 271 284 271
q15 542 479 474 474
q16 498 440 426 426
q17 1831 1494 1467 1467
q18 8211 7645 7353 7353
q19 1777 1590 1507 1507
q20 3025 1796 1792 1792
q21 9166 4737 4806 4737
q22 728 530 522 522
Total cold run time: 78161 ms
Total hot run time: 55019 ms
TPC-DS: Total hot run time: 169836 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 10abf21e2cc10bc7cf80fd6b60ceac4c51f13733, data reload: false
query1 928 382 377 377
query2 6452 2310 2282 2282
query3 6647 213 210 210
query4 20090 17148 17425 17148
query5 4143 455 444 444
query6 262 166 156 156
query7 4590 301 294 294
query8 329 284 289 284
query9 8499 2361 2341 2341
query10 452 297 274 274
query11 10706 10224 10004 10004
query12 137 91 86 86
query13 1640 377 378 377
query14 9498 7503 6870 6870
query15 230 190 184 184
query16 7521 270 263 263
query17 1394 524 518 518
query18 1934 281 265 265
query19 193 157 158 157
query20 92 96 85 85
query21 205 136 128 128
query22 4298 3934 3905 3905
query23 33651 33160 33082 33082
query24 11260 2884 2759 2759
query25 617 355 370 355
query26 1177 156 153 153
query27 3037 317 321 317
query28 7539 2048 2067 2048
query29 872 608 622 608
query30 270 147 154 147
query31 965 768 744 744
query32 89 51 54 51
query33 757 276 274 274
query34 975 492 467 467
query35 747 631 624 624
query36 1084 947 923 923
query37 157 65 70 65
query38 2939 2832 2767 2767
query39 864 789 794 789
query40 214 124 127 124
query41 53 54 53 53
query42 122 99 96 96
query43 603 552 538 538
query44 1212 736 765 736
query45 207 172 179 172
query46 1064 726 737 726
query47 1892 1770 1770 1770
query48 356 299 298 298
query49 1091 425 444 425
query50 786 388 397 388
query51 6779 6649 6627 6627
query52 99 96 85 85
query53 361 289 289 289
query54 854 462 476 462
query55 74 72 73 72
query56 272 258 261 258
query57 1130 1044 1034 1034
query58 247 268 249 249
query59 3427 3051 3338 3051
query60 293 288 268 268
query61 92 92 90 90
query62 653 488 447 447
query63 314 302 294 294
query64 8869 2252 1780 1780
query65 3135 3059 3094 3059
query66 838 336 328 328
query67 15091 14964 14905 14905
query68 4504 558 566 558
query69 476 315 312 312
query70 1155 1126 1089 1089
query71 415 290 284 284
query72 7294 2876 2696 2696
query73 748 325 326 325
query74 6116 5714 5623 5623
query75 3373 2654 2677 2654
query76 2590 924 915 915
query77 457 306 304 304
query78 10394 9751 9793 9751
query79 2279 511 511 511
query80 2309 486 473 473
query81 587 222 225 222
query82 824 105 110 105
query83 313 181 180 180
query84 275 90 99 90
query85 2055 331 332 331
query86 487 296 325 296
query87 3314 3152 3193 3152
query88 4139 2446 2430 2430
query89 483 400 376 376
query90 1807 205 191 191
query91 139 108 109 108
query92 67 52 53 52
query93 2282 518 509 509
query94 1208 225 199 199
query95 430 320 318 318
query96 589 269 269 269
query97 3181 2984 3014 2984
query98 251 227 226 226
query99 1249 854 861 854
Total cold run time: 273158 ms
Total hot run time: 169836 ms
ClickBench: Total hot run time: 31.17 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 10abf21e2cc10bc7cf80fd6b60ceac4c51f13733, data reload: false
query1 0.04 0.03 0.03
query2 0.08 0.03 0.04
query3 0.24 0.05 0.05
query4 1.69 0.08 0.08
query5 0.50 0.48 0.49
query6 1.12 0.73 0.73
query7 0.02 0.02 0.01
query8 0.05 0.04 0.04
query9 0.53 0.49 0.48
query10 0.55 0.56 0.55
query11 0.15 0.12 0.11
query12 0.15 0.12 0.11
query13 0.60 0.60 0.59
query14 0.77 0.77 0.78
query15 0.83 0.81 0.80
query16 0.36 0.37 0.37
query17 1.01 0.98 1.02
query18 0.23 0.23 0.25
query19 1.83 1.73 1.79
query20 0.02 0.01 0.01
query21 15.73 0.66 0.65
query22 4.67 6.65 2.38
query23 18.30 1.41 1.32
query24 2.04 0.23 0.22
query25 0.14 0.09 0.08
query26 0.27 0.16 0.17
query27 0.08 0.09 0.08
query28 13.27 1.10 1.08
query29 13.18 3.32 3.30
query30 0.24 0.05 0.06
query31 2.87 0.38 0.38
query32 3.29 0.48 0.47
query33 2.93 2.92 2.86
query34 17.09 4.41 4.46
query35 4.53 4.62 4.49
query36 0.65 0.45 0.47
query37 0.17 0.16 0.16
query38 0.15 0.14 0.14
query39 0.06 0.03 0.04
query40 0.18 0.15 0.16
query41 0.09 0.05 0.05
query42 0.06 0.05 0.05
query43 0.04 0.03 0.03
Total cold run time: 110.8 s
Total hot run time: 31.17 s
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
PR approved by at least one committer and no changes requested.