pinot icon indicating copy to clipboard operation
pinot copied to clipboard

Published 20 hours ago • verified publisher icon apache

Upsert Enhancements

Open Jackie-Jiang opened this issue 3 years ago • 1 comments

  • Improve the performance of constructing upsert metadata during server restart/table reload (related issue #7569)
  • Improve the performance of removing a segment from upsert metadata
  • Use disk space to store upsert metadata to avoid using too much memory for table with high primary key cardinality
  • Support retention for upsert metadata (only allow upsert for the latest time window to reduce the size of the upsert metadata)
  • Support segment compaction for upsert segment, remove invalid records and recreate segment (related issue #6912)
  • Fix inconsistent issue during segment commit (related issue #7849)

Jackie-Jiang avatar May 23 '22 19:05 Jackie-Jiang

since not all linked issues are resolved, should we reopen this issue, make a tasklist from it and ad the parent issue label? similar https://github.com/apache/pinot/issues/13436#issuecomment-2178829380

edit: or could we simply closed the remaining linked open issues as complete?

hpvd avatar Jun 21 '24 08:06 hpvd