hudi
hudi copied to clipboard
[Draft][HUDI-7265] Support schema evolution by Flink SQL using HoodieHiveCatalog
Change Logs
Since Flink 1.17, Flink SQL support more advanced alter table syntax.
-- add a new column
ALTER TABLE MyTable ADD category_id STRING COMMENT 'identifier of the category';
-- modify a column type, comment and position
ALTER TABLE MyTable MODIFY measurement double COMMENT 'unit is bytes per second' AFTER `id`;
-- drop columns
ALTER TABLE MyTable DROP (col1, col2, col3);
-- rename column
ALTER TABLE MyTable RENAME request_body TO payload;
Find more detail information in Flink Alter Table SQL .
We could support schema evolution by Flink SQL.
This pr aims to support it based on HoodieHiveCatalog
.
Based on HoodieCatalog
is not included in this pr, and would be in the later PR.
Impact
None
Risk level (write none, low medium or high below)
None
Documentation Update
None
Contributor's checklist
- [ ] Read through contributor's guide
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
@hudi-bot run azure
CI report:
- 0510337de5adb626429e72da5539b9f23231974f Azure: SUCCESS
Bot commands
@hudi-bot supports the following commands:-
@hudi-bot run azure
re-run the last Azure build