starrocks
starrocks copied to clipboard
Support repairing cloud-native tables with missing files
Enhancement
In shared-data mode, cloud native table has only a single storage replica. If any files are lost (including metadata or data files), queries and load jobs will continuously fail with file not found errors.
Introduce a mechanism to roll back to a previous normal version.
First, FE gets several latest metadatas of all tablets in the partition. Then, FE selects the normal metadata for every tablet based on the properties. Finally, FE sends the normal metadatas to BE for repair.
admin repair table t1 partition (p1)
properties(
"enforce_consistent_version" = "true",
"allow_empty_tablet_recovery" = "false",
"ignore_lost_data_files" = "false"
);
- [x] https://github.com/StarRocks/starrocks/pull/66005
- [x] https://github.com/StarRocks/starrocks/pull/66011
- [x] https://github.com/StarRocks/starrocks/pull/66425
- [ ] https://github.com/StarRocks/starrocks/pull/66569