hudi icon indicating copy to clipboard operation
hudi copied to clipboard

[Draft][HUDI-7265] Support schema evolution by Flink SQL using HoodieHiveCatalog

Open beyond1920 opened this issue 1 year ago • 1 comments

Change Logs

Since Flink 1.17, Flink SQL support more advanced alter table syntax.

-- add a new column 
ALTER TABLE MyTable ADD category_id STRING COMMENT 'identifier of the category';
-- modify a column type, comment and position
ALTER TABLE MyTable MODIFY measurement double COMMENT 'unit is bytes per second' AFTER `id`;
-- drop columns
ALTER TABLE MyTable DROP (col1, col2, col3);
-- rename column
ALTER TABLE MyTable RENAME request_body TO payload;

Find more detail information in Flink Alter Table SQL .

We could support schema evolution by Flink SQL. This pr aims to support it based on HoodieHiveCatalog. Based on HoodieCatalog is not included in this pr, and would be in the later PR.

Impact

None

Risk level (write none, low medium or high below)

None

Documentation Update

None

Contributor's checklist

  • [ ] Read through contributor's guide
  • [ ] Change Logs and Impact were stated clearly
  • [ ] Adequate tests were added if applicable
  • [ ] CI passed

beyond1920 avatar Dec 28 '23 04:12 beyond1920

@hudi-bot run azure

beyond1920 avatar Dec 30 '23 03:12 beyond1920

CI report:

  • 0510337de5adb626429e72da5539b9f23231974f Azure: SUCCESS
Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

hudi-bot avatar Jan 09 '24 07:01 hudi-bot