starrocks icon indicating copy to clipboard operation
starrocks copied to clipboard

[Feature] Support materialized view for external table (step 2/3)

Open Youngwb opened this issue 2 years ago • 2 comments

What type of PR is this:

  • [ ] BugFix
  • [x] Feature
  • [ ] Enhancement
  • [ ] Refactor
  • [ ] UT
  • [ ] Doc
  • [ ] Tool

Which issues of this PR fixes :

#11116

Problem Summary(Required) :

This PR support create materialzied view for hive/hudi partitioned table, I will support iceberg partitioned table later. Major changes:

  1. Materialized view Analyzer for check base table partition column with mv partition
  2. Add partition from hudi/hive table which partition key is value to olap table which partition key is range.

Checklist:

  • [ ] I have added test cases for my bug fix or my new feature
  • [ ] I have added user document for my new feature or new function

Youngwb avatar Sep 23 '22 08:09 Youngwb

run starrocks_admit_test

murphyatwork avatar Sep 25 '22 14:09 murphyatwork

[FE PR Coverage Check]

:disappointed: fail : 43 / 143 (30.07%)

file detail

path covered_line new_line coverage not_covered_line_detail
:large_blue_circle: com/starrocks/catalog/Table.java 0 2 00.00% [210, 214]
:large_blue_circle: com/starrocks/analysis/LiteralExpr.java 0 6 00.00% [113, 114, 119, 121, 124, 126]
:large_blue_circle: com/starrocks/external/HiveMetaStoreTableUtils.java 0 32 00.00% [387, 388, 389, 390, 391, 393, 394, 395, 396, 397, 398, 399, 400, 401, 402, 403, 404, 405, 406, 408, 410, 411, 413, 414, 415, 416, 417, 418, 419, 420, 421, 423]
:large_blue_circle: com/starrocks/analysis/DateLiteral.java 0 1 00.00% [176]
:large_blue_circle: com/starrocks/analysis/IntLiteral.java 0 12 00.00% [189, 190, 192, 193, 195, 196, 198, 199, 201, 202, 204, 207]
:large_blue_circle: com/starrocks/analysis/LargeIntLiteral.java 0 4 00.00% [104, 105, 106, 107]
:large_blue_circle: com/starrocks/scheduler/PartitionBasedMaterializedViewRefreshProcessor.java 22 49 44.90% [260, 261, 262, 264, 266, 292, 293, 294, 485, 493, 505, 506, 507, 508, 511, 512, 513, 514, 515, 516, 517, 518, 519, 522, 526, 527, 528]
:large_blue_circle: com/starrocks/sql/analyzer/MaterializedViewAnalyzer.java 18 33 54.55% [334, 335, 337, 368, 372, 377, 384, 385, 386, 387, 390, 391, 394, 395, 396]
:large_blue_circle: com/starrocks/catalog/MaterializedView.java 3 4 75.00% [125]

wanpengfei-git avatar Sep 27 '22 11:09 wanpengfei-git

run starrocks_clang-tidy

wangruin avatar Sep 27 '22 12:09 wangruin

run starrocks_admit_test

wanpengfei-git avatar Sep 27 '22 12:09 wanpengfei-git