venice icon indicating copy to clipboard operation
venice copied to clipboard

[WIP] Utilize temp cache and skip syncOffset during CATCHING_UP phase

Open zx0401 opened this issue 1 year ago • 0 comments

[changelog][BootstrappingVeniceChangelogConsumer] Utilize temp cache and skip syncOffset during CATCHING_UP phase to improve bootstrapping performance

Summary, imperative, start upper case, don't end with a period

  • Skip syncOffset during CATCHING_UP phase
  • During CATCHING_UP phase, we'll save raw data in a temporary hash map
  • On completion of CATCHING_UP, we'll process records in temporary hash map and save in storage

How was this PR tested?

  • unit test

Does this PR introduce any user-facing changes?

  • [x] No. You can skip the rest of this section.
  • [ ] Yes. Make sure to explain your proposed changes and call out the behavior change.

zx0401 avatar May 07 '24 21:05 zx0401