starrocks icon indicating copy to clipboard operation
starrocks copied to clipboard

Support repairing cloud-native tables with missing files

Open wyb opened this issue 1 month ago • 0 comments

Enhancement

In shared-data mode, cloud native table has only a single storage replica. If any files are lost (including metadata or data files), queries and load jobs will continuously fail with file not found errors.

Introduce a mechanism to roll back to a previous normal version.

First, FE gets several latest metadatas of all tablets in the partition. Then, FE selects the normal metadata for every tablet based on the properties. Finally, FE sends the normal metadatas to BE for repair.

admin repair table t1 partition (p1) 
properties(
  "enforce_consistent_version" = "true",
  "allow_empty_tablet_recovery" = "false",
  "ignore_lost_data_files" = "false"
);
  • [x] https://github.com/StarRocks/starrocks/pull/66005
  • [x] https://github.com/StarRocks/starrocks/pull/66011
  • [x] https://github.com/StarRocks/starrocks/pull/66425
  • [ ] https://github.com/StarRocks/starrocks/pull/66569

wyb avatar Nov 27 '25 06:11 wyb