delta
delta copied to clipboard
[Kernel][Type Widening] 9/ Add iceberg compat check for type changes
🥞 Stacked PR
Use this link to review incremental changes.
Which Delta project/connector is this regarding?
- [ ] Spark
- [ ] Standalone
- [ ] Flink
- [x] Kernel
- [ ] Other (fill in here)
Description
This PR adds a validator to ensure only iceberg compatible type changes are present before enabling IcebergCompatV2.
Resolves #4491
How was this patch tested?
Added direct unit tests, and integration tests to check that the feature can be turned on with valid type changes, and throws an exception when invalid type changes are present.
Does this PR introduce any user-facing changes?
This adds validation for type-widening so if there are tables that do not follow the protocol, it could start rejecting some writes.