doris
doris copied to clipboard
apache
[enhance](catalog)show partitions support iceberg
Proposed changes
Issue Number: close #xxx
mysql> show partitions from sample_cow_parquet;
+----------------------------------------------------------+
| Partition |
+----------------------------------------------------------+
| col_timestamp_day=1970-01-01/city=Beijing/id_bucket=0 |
| col_timestamp_day=1970-01-01/city=Beijing/id_bucket=1 |
| col_timestamp_day=1970-01-01/city=Hangzhou/id_bucket=0 |
| col_timestamp_day=1970-01-01/city=Hangzhou/id_bucket=1 |
| col_timestamp_day=1970-01-01/city=Hefei/id_bucket=0 |
| col_timestamp_day=1970-01-01/city=Hefei/id_bucket=1 |
| col_timestamp_day=1970-01-01/city=Shanghai/id_bucket=0 |
| col_timestamp_day=1970-01-01/city=Shanghai/id_bucket=1 |
| col_timestamp_day=1970-01-01/id_bucket=0 |
| col_timestamp_day=1970-01-01/id_bucket=0/col_short=18810 |
| col_timestamp_day=1970-01-02/city=Beijing/id_bucket=0 |
| col_timestamp_day=1970-01-02/city=Beijing/id_bucket=1 |
| col_timestamp_day=1970-01-02/city=Hangzhou/id_bucket=0 |
| col_timestamp_day=1970-01-02/city=Hangzhou/id_bucket=1 |
| col_timestamp_day=1970-01-02/city=Hefei/id_bucket=0 |
| col_timestamp_day=1970-01-02/city=Hefei/id_bucket=1 |
| col_timestamp_day=1970-01-02/city=Shanghai/id_bucket=0 |
| col_timestamp_day=1970-01-02/city=Shanghai/id_bucket=1 |
| col_timestamp_day=1970-01-03/city=Beijing/id_bucket=0 |
| col_timestamp_day=1970-01-03/city=Beijing/id_bucket=1 |
| col_timestamp_day=1970-01-03/city=Hangzhou/id_bucket=0 |
| col_timestamp_day=1970-01-03/city=Hangzhou/id_bucket=1 |
| col_timestamp_day=1970-01-03/city=Hefei/id_bucket=0 |
| col_timestamp_day=1970-01-03/city=Hefei/id_bucket=1 |
| col_timestamp_day=1970-01-03/city=Shanghai/id_bucket=0 |
| col_timestamp_day=1970-01-03/city=Shanghai/id_bucket=1 |
| col_timestamp_day=1970-01-04/city=Beijing/id_bucket=0 |
| col_timestamp_day=1970-01-04/city=Beijing/id_bucket=1 |
| col_timestamp_day=1970-01-04/city=Hangzhou/id_bucket=0 |
| col_timestamp_day=1970-01-04/city=Hangzhou/id_bucket=1 |
| col_timestamp_day=1970-01-04/city=Hefei/id_bucket=0 |
| col_timestamp_day=1970-01-04/city=Hefei/id_bucket=1 |
| col_timestamp_day=1970-01-04/city=Shanghai/id_bucket=0 |
| col_timestamp_day=1970-01-04/city=Shanghai/id_bucket=1 |
+----------------------------------------------------------+
34 rows in set (0.06 sec)
Further comments
If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.
TPC-H: Total hot run time: 40430 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3432b8bbb3db2da443b64c835e86393f966f8ec9, data reload: false
------ Round 1 ----------------------------------
q1 17854 4418 4275 4275
q2 2021 191 187 187
q3 10536 1177 1282 1177
q4 10177 706 828 706
q5 7478 2640 2601 2601
q6 215 133 135 133
q7 950 603 579 579
q8 9215 2086 2084 2084
q9 9066 6492 6486 6486
q10 9008 3717 3686 3686
q11 456 249 249 249
q12 463 227 222 222
q13 17770 2982 3004 2982
q14 271 228 213 213
q15 517 460 479 460
q16 519 381 376 376
q17 985 622 704 622
q18 8223 7397 7437 7397
q19 7733 1567 1486 1486
q20 665 313 310 310
q21 4940 3926 4013 3926
q22 353 273 275 273
Total cold run time: 119415 ms
Total hot run time: 40430 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4360 4231 4252 4231
q2 385 275 265 265
q3 2967 2793 2709 2709
q4 1849 1591 1602 1591
q5 5279 5309 5302 5302
q6 212 123 126 123
q7 2149 1760 1750 1750
q8 3206 3364 3320 3320
q9 8350 8342 8501 8342
q10 3877 3652 3691 3652
q11 609 492 487 487
q12 790 613 635 613
q13 16448 2972 2997 2972
q14 304 253 258 253
q15 517 474 487 474
q16 487 437 446 437
q17 1781 1496 1463 1463
q18 7664 7657 7426 7426
q19 1659 1578 1594 1578
q20 1997 1793 1784 1784
q21 4819 4711 4686 4686
q22 576 488 499 488
Total cold run time: 70285 ms
Total hot run time: 53946 ms
TPC-DS: Total hot run time: 170218 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3432b8bbb3db2da443b64c835e86393f966f8ec9, data reload: false
query1 923 392 380 380
query2 6450 2401 2417 2401
query3 6649 204 206 204
query4 21828 17425 17380 17380
query5 4217 421 457 421
query6 258 181 160 160
query7 4583 313 294 294
query8 257 189 181 181
query9 8511 2375 2354 2354
query10 449 290 273 273
query11 10588 10332 9977 9977
query12 140 100 97 97
query13 1646 383 374 374
query14 10228 7048 7016 7016
query15 211 174 175 174
query16 7803 301 264 264
query17 1366 546 529 529
query18 1960 279 277 277
query19 209 157 166 157
query20 97 84 88 84
query21 201 134 136 134
query22 4135 3896 3997 3896
query23 33510 33034 33127 33034
query24 12196 2767 2844 2767
query25 662 370 369 369
query26 1814 158 161 158
query27 3033 333 346 333
query28 7641 2051 2037 2037
query29 1155 625 607 607
query30 291 151 157 151
query31 980 776 741 741
query32 91 53 55 53
query33 766 276 272 272
query34 1049 486 483 483
query35 746 635 633 633
query36 1088 930 916 916
query37 276 66 69 66
query38 2933 2760 2764 2760
query39 856 807 791 791
query40 277 138 130 130
query41 48 47 44 44
query42 101 99 96 96
query43 561 588 564 564
query44 1298 751 780 751
query45 178 165 163 163
query46 1093 748 736 736
query47 1819 1765 1743 1743
query48 388 308 301 301
query49 1192 393 403 393
query50 793 408 390 390
query51 6912 6806 6752 6752
query52 103 93 91 91
query53 361 296 292 292
query54 945 438 434 434
query55 76 76 75 75
query56 301 254 256 254
query57 1154 1040 1054 1040
query58 241 214 214 214
query59 3393 3308 3215 3215
query60 293 260 265 260
query61 94 92 90 90
query62 673 459 463 459
query63 315 297 292 292
query64 9829 2295 1705 1705
query65 3198 3124 3148 3124
query66 1378 344 334 334
query67 15184 15020 14759 14759
query68 4535 543 534 534
query69 495 275 279 275
query70 1203 1106 1147 1106
query71 430 279 271 271
query72 7619 5466 2739 2739
query73 738 339 325 325
query74 6000 5709 5653 5653
query75 3788 2617 2638 2617
query76 3169 1010 959 959
query77 630 329 274 274
query78 10220 9847 9782 9782
query79 1299 534 535 534
query80 815 457 452 452
query81 495 226 229 226
query82 662 98 94 94
query83 194 171 169 169
query84 241 97 93 93
query85 1419 282 267 267
query86 399 326 297 297
query87 3294 3099 3134 3099
query88 3487 2444 2455 2444
query89 480 395 382 382
query90 1945 194 198 194
query91 129 102 98 98
query92 115 51 52 51
query93 1053 519 509 509
query94 1186 192 191 191
query95 398 312 315 312
query96 582 271 269 269
query97 3228 3067 3044 3044
query98 240 222 215 215
query99 1197 848 844 844
Total cold run time: 275679 ms
Total hot run time: 170218 ms
ClickBench: Total hot run time: 30.46 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3432b8bbb3db2da443b64c835e86393f966f8ec9, data reload: false
query1 0.04 0.03 0.03
query2 0.08 0.03 0.04
query3 0.23 0.06 0.05
query4 1.66 0.10 0.10
query5 0.50 0.49 0.51
query6 1.12 0.73 0.73
query7 0.02 0.01 0.01
query8 0.05 0.04 0.04
query9 0.53 0.50 0.49
query10 0.55 0.55 0.53
query11 0.15 0.10 0.11
query12 0.15 0.11 0.11
query13 0.60 0.59 0.59
query14 0.78 0.79 0.80
query15 0.84 0.83 0.81
query16 0.37 0.37 0.36
query17 0.95 0.98 0.94
query18 0.22 0.26 0.24
query19 1.82 1.69 1.69
query20 0.01 0.01 0.01
query21 16.12 0.65 0.64
query22 4.38 7.47 1.94
query23 18.26 1.42 1.22
query24 1.78 0.28 0.21
query25 0.15 0.09 0.09
query26 0.26 0.17 0.17
query27 0.09 0.08 0.09
query28 13.35 1.05 1.07
query29 12.69 3.27 3.23
query30 0.25 0.06 0.05
query31 2.88 0.38 0.37
query32 3.28 0.48 0.49
query33 2.84 2.88 2.89
query34 17.13 4.39 4.43
query35 4.53 4.50 4.46
query36 0.65 0.48 0.48
query37 0.18 0.16 0.15
query38 0.15 0.14 0.14
query39 0.05 0.04 0.03
query40 0.17 0.14 0.14
query41 0.09 0.05 0.05
query42 0.05 0.04 0.05
query43 0.04 0.03 0.04
Total cold run time: 110.04 s
Total hot run time: 30.46 s
We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable. If you'd like to revive this PR, please reopen it and feel free a maintainer to remove the Stale tag!
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}