starrocks icon indicating copy to clipboard operation
starrocks copied to clipboard

[Enhancement] Unified Catalog support Paimon

Open mxdzs0612 opened this issue 1 year ago • 3 comments

Why I'm doing:

Make unified catalog support paimon data sources.

example:

CREATE EXTERNAL CATALOG unified
PROPERTIES
(
    "type" = "unified",
    "unified.metastore.type" = "hive",
    "hive.metastore.uris" = "thrift://localhost:9083",
    "paimon.catalog.warehouse" = "hdfs://127.0.0.1:9000/paimon",
);

What I'm doing:

Fixes #issue

What type of PR is this:

  • [ ] BugFix
  • [ ] Feature
  • [x] Enhancement
  • [ ] Refactor
  • [ ] UT
  • [ ] Doc
  • [ ] Tool

Does this PR entail a change in behavior?

  • [ ] Yes, this PR will result in a change in behavior.
  • [x] No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

  • [ ] Interface/UI changes: syntax, type conversion, expression evaluation, display information
  • [ ] Parameter changes: default values, similar parameters but with different default values
  • [ ] Policy changes: use new policy to replace old one, functionality automatically enabled
  • [ ] Feature removed
  • [ ] Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

  • [x] I have added test cases for my bug fix or my new feature
  • [ ] This pr needs user documentation (for new or modified features or behaviors)
    • [ ] I have added documentation for my new feature or new function
  • [ ] This is a backport pr

Bugfix cherry-pick branch check:

  • [x] I have checked the version labels which the pr will be auto-backported to the target branch
    • [x] 3.3
    • [x] 3.2
    • [ ] 3.1
    • [ ] 3.0
    • [ ] 2.5

mxdzs0612 avatar Jun 24 '24 09:06 mxdzs0612

please rebase main

stephen-shelby avatar Aug 02 '24 06:08 stephen-shelby

[FE Incremental Coverage Report]

:white_check_mark: pass : 17 / 20 (85.00%)

file detail

path covered_line new_line coverage not_covered_line_detail
:large_blue_circle: com/starrocks/connector/unified/UnifiedMetadata.java 1 2 50.00% [103]
:large_blue_circle: com/starrocks/catalog/PaimonTable.java 3 5 60.00% [47, 48]
:large_blue_circle: com/starrocks/connector/paimon/PaimonConnector.java 2 2 100.00% []
:large_blue_circle: com/starrocks/connector/unified/UnifiedConnector.java 11 11 100.00% []

github-actions[bot] avatar Aug 03 '24 11:08 github-actions[bot]

[BE Incremental Coverage Report]

:white_check_mark: pass : 0 / 0 (0%)

github-actions[bot] avatar Aug 03 '24 11:08 github-actions[bot]

@Mergifyio backport branch-3.3

github-actions[bot] avatar Nov 08 '24 09:11 github-actions[bot]

@Mergifyio backport branch-3.2

github-actions[bot] avatar Nov 08 '24 09:11 github-actions[bot]

backport branch-3.3

✅ Backports have been created

mergify[bot] avatar Nov 08 '24 09:11 mergify[bot]

backport branch-3.2

✅ Backports have been created

mergify[bot] avatar Nov 08 '24 09:11 mergify[bot]

ignore backport check: 3.3.6

wangsimo0 avatar Nov 11 '24 03:11 wangsimo0