deephaven-core icon indicating copy to clipboard operation
deephaven-core copied to clipboard
verified publisher icon deephaven

feat: Refactor PartitioningColumnDataIndex in support of refreshing Iceberg tables

Open rcaudy opened this issue 1 year ago • 2 comments

Improve and refactor PartitioningColumnDataIndex to support the expected types of location changes that will be introduced by refreshing Iceberg tables:

  1. Move responsibility for location table row set shifting to RegionedColumnSourceManager
  2. Support location removes and resurrections in PartitioningColumnDataIndex
  3. Correct modify handling (previous tracking) in PartitioningColumnDataIndex

rcaudy avatar Aug 08 '24 20:08 rcaudy

This PR is intended to be merged ahead of or with #5707. It currently needs more unit testing. That should come along with the refreshing Iceberg changes.

rcaudy avatar Aug 08 '24 20:08 rcaudy

Note, there may be conflicts due to https://github.com/deephaven/deephaven-core/pull/5942

rcaudy avatar Aug 15 '24 16:08 rcaudy

Merged as part of #5707

rcaudy avatar Oct 24 '24 22:10 rcaudy