pinot icon indicating copy to clipboard operation
pinot copied to clipboard

Upsert Compaction: CRC mismatch robustness

Open tibrewalpratik17 opened this issue 1 year ago • 1 comments

This issue of CRC mismatches across replicas for a segment has been discussed multiple times (https://github.com/apache/pinot/issues/12396, https://github.com/apache/pinot/issues/11004). I'm creating this parent issue to track how these mismatches affect the Upsert compaction flow overall. While eliminating CRC mismatches entirely would be ideal, until we find the best solution for that, we can focus on making the Upsert compaction flow robust enough to handle such mismatches.

  • [ ] https://github.com/apache/pinot/issues/13492
  • [ ] https://github.com/apache/pinot/issues/13491
  • [ ] https://github.com/apache/pinot/issues/13494

tibrewalpratik17 avatar Jun 27 '24 05:06 tibrewalpratik17

you could add new parent-issue label

hpvd avatar Jun 29 '24 09:06 hpvd