delta-rs
delta-rs copied to clipboard
feat: implement transaction identifiers
Description
Enable users to read transactions identifiers on table and allows writing of transactions identifiers for all operations.
Related Issue(s)
- closes #2130
@roeap Please provide some feedback on how I'm interacting with the log replay.
Transaction Identifiers are at the DeltaTableState
level which encapsulates a EagerSnapshot
however EagerSnapshot
is responsible for using LogReplayStream
for reading checkpoint and commit files. Either I move the application transcription into the eager snapshot, read the same files twice, or implement some hook
for when the replay is being performed.
I implemented the hook with a visitor trait called ReplayVisitor
which can be used whenever a new EagerSnapshot
is being created or whenever states are being updated merged. This will allow information from checkpoints & commits to flow upwards depending on what feature are being used.
@Blajda - very sorry for the long delay! Will do a review now.