delta-rs icon indicating copy to clipboard operation
delta-rs copied to clipboard

feat: implement transaction identifiers

Open Blajda opened this issue 11 months ago • 2 comments

Description

Enable users to read transactions identifiers on table and allows writing of transactions identifiers for all operations.

Related Issue(s)

  • closes #2130

Blajda avatar Mar 24 '24 04:03 Blajda

@roeap Please provide some feedback on how I'm interacting with the log replay. Transaction Identifiers are at the DeltaTableState level which encapsulates a EagerSnapshot however EagerSnapshot is responsible for using LogReplayStream for reading checkpoint and commit files. Either I move the application transcription into the eager snapshot, read the same files twice, or implement some hook for when the replay is being performed.

I implemented the hook with a visitor trait called ReplayVisitor which can be used whenever a new EagerSnapshot is being created or whenever states are being updated merged. This will allow information from checkpoints & commits to flow upwards depending on what feature are being used.

Blajda avatar Mar 24 '24 04:03 Blajda

@Blajda - very sorry for the long delay! Will do a review now.

roeap avatar May 10 '24 17:05 roeap