delta
delta copied to clipboard
[Spark][3.2] Fix CommitInfo.inCommitTimestamp deserialization for very small timestamps
Which Delta project/connector is this regarding?
- [X] Spark
- [ ] Standalone
- [ ] Flink
- [ ] Kernel
- [ ] Other (fill in here)
Description
Currently, if we deserialize a CommitInfo with a very small inCommitTimestamp and then try to access this inCommitTimestamp, this exception is thrown
java.lang.ClassCastException: class java.lang.Integer cannot be cast to class java.lang.Long
This PR fixes the CommitInfo so that the inCommitTimestamp field is deserialized correctly.
How was this patch tested?
Added a new test case that was failing before the fix.
Does this PR introduce any user-facing changes?
No