trino icon indicating copy to clipboard operation
trino copied to clipboard

Delta Lake: Add `partitionValues` information to the `remove` transaction log entries

Open findinpath opened this issue 1 year ago • 1 comments

Description

This information can be particularly useful in the context of concurrent writes operations to identify overlaps between the partitions being read by the current operation and the partitions updated by an already committed operation.

Additional context and related issues

#18506

https://github.com/delta-io/delta/blob/master/PROTOCOL.md#add-file-and-remove-file

Release notes

(x) This is not user-visible or is docs only, and no release notes are required. ( ) Release notes are required. Please propose a release note for me. ( ) Release notes are required, with the following suggested text:

# Section
* Fix some things. ({issue}`issuenumber`)

findinpath avatar Jan 29 '24 12:01 findinpath

@ebyhr @alexjo2144 can you PTAL?

findepi avatar Jan 31 '24 14:01 findepi

This pull request has gone a while without any activity. Tagging the Trino developer relations team: @bitsondatadev @colebow @mosabua

github-actions[bot] avatar Mar 07 '24 17:03 github-actions[bot]

Shorten the commit title and removed a redundant space from commit message.

ebyhr avatar Mar 15 '24 07:03 ebyhr