delta icon indicating copy to clipboard operation
delta copied to clipboard

[Spark][3.2] Fix CommitInfo.inCommitTimestamp deserialization for very small timestamps

Open dhruvarya-db opened this issue 9 months ago • 0 comments

Which Delta project/connector is this regarding?

  • [X] Spark
  • [ ] Standalone
  • [ ] Flink
  • [ ] Kernel
  • [ ] Other (fill in here)

Description

Currently, if we deserialize a CommitInfo with a very small inCommitTimestamp and then try to access this inCommitTimestamp, this exception is thrown

java.lang.ClassCastException: class java.lang.Integer cannot be cast to class java.lang.Long

This PR fixes the CommitInfo so that the inCommitTimestamp field is deserialized correctly.

How was this patch tested?

Added a new test case that was failing before the fix.

Does this PR introduce any user-facing changes?

No

dhruvarya-db avatar May 03 '24 23:05 dhruvarya-db