starrocks
starrocks copied to clipboard
[Feature] Support materialized view for external table (step 2/3)
What type of PR is this:
- [ ] BugFix
- [x] Feature
- [ ] Enhancement
- [ ] Refactor
- [ ] UT
- [ ] Doc
- [ ] Tool
Which issues of this PR fixes :
#11116
Problem Summary(Required) :
This PR support create materialzied view for hive/hudi partitioned table, I will support iceberg partitioned table later. Major changes:
- Materialized view Analyzer for check base table partition column with mv partition
- Add partition from hudi/hive table which partition key is value to olap table which partition key is range.
Checklist:
- [ ] I have added test cases for my bug fix or my new feature
- [ ] I have added user document for my new feature or new function
run starrocks_admit_test
[FE PR Coverage Check]
:disappointed: fail : 43 / 143 (30.07%)
file detail
path | covered_line | new_line | coverage | not_covered_line_detail | |
---|---|---|---|---|---|
:large_blue_circle: | com/starrocks/catalog/Table.java | 0 | 2 | 00.00% | [210, 214] |
:large_blue_circle: | com/starrocks/analysis/LiteralExpr.java | 0 | 6 | 00.00% | [113, 114, 119, 121, 124, 126] |
:large_blue_circle: | com/starrocks/external/HiveMetaStoreTableUtils.java | 0 | 32 | 00.00% | [387, 388, 389, 390, 391, 393, 394, 395, 396, 397, 398, 399, 400, 401, 402, 403, 404, 405, 406, 408, 410, 411, 413, 414, 415, 416, 417, 418, 419, 420, 421, 423] |
:large_blue_circle: | com/starrocks/analysis/DateLiteral.java | 0 | 1 | 00.00% | [176] |
:large_blue_circle: | com/starrocks/analysis/IntLiteral.java | 0 | 12 | 00.00% | [189, 190, 192, 193, 195, 196, 198, 199, 201, 202, 204, 207] |
:large_blue_circle: | com/starrocks/analysis/LargeIntLiteral.java | 0 | 4 | 00.00% | [104, 105, 106, 107] |
:large_blue_circle: | com/starrocks/scheduler/PartitionBasedMaterializedViewRefreshProcessor.java | 22 | 49 | 44.90% | [260, 261, 262, 264, 266, 292, 293, 294, 485, 493, 505, 506, 507, 508, 511, 512, 513, 514, 515, 516, 517, 518, 519, 522, 526, 527, 528] |
:large_blue_circle: | com/starrocks/sql/analyzer/MaterializedViewAnalyzer.java | 18 | 33 | 54.55% | [334, 335, 337, 368, 372, 377, 384, 385, 386, 387, 390, 391, 394, 395, 396] |
:large_blue_circle: | com/starrocks/catalog/MaterializedView.java | 3 | 4 | 75.00% | [125] |
run starrocks_clang-tidy
run starrocks_admit_test