delta
delta copied to clipboard
[Kernel][Type Widening] 7/ Collect TypeChanges to FieldMetadata
🥞 Stacked PR
Use this link to review incremental changes.
Which Delta project/connector is this regarding?
- [ ] Spark
- [ ] Standalone
- [ ] Flink
- [x] Kernel
- [ ] Other (fill in here)
Description
This PR adds logic to collect type changes from leaf fields and appropriately populate FieldMetadata on the nearest StructField, following the pattern already established by collations. Because this is on the StructField it means extra work is performed for nested maps/elements, fixing this is outside the scope of the PR>
How was this patch tested?
New unit tests.