sui icon indicating copy to clipboard operation
sui copied to clipboard

[pruner] keep last N epochs of objects data

Open phoenix-o opened this issue 3 years ago • 1 comments

the current version of pruner is implemented in an aggressive fashion: it subscribes to executed checkpoint stream and removes all previous object versions. This allows to remove stale data ASAP, but doesn’t work well with the following use cases:

  • in future iterations of the product, indexer will need a reasonable time window to access old versions of objects
  • we might need to delay pruning for debugging purposes

This PR changes the flow to keep old object versions for the last N epochs of data and makes the parameter configurable. To simulate aggressive behaviour it can be set to 0

phoenix-o avatar Feb 16 '23 12:02 phoenix-o

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated
explorer ✅ Ready (Inspect) Visit Preview 💬 Add your feedback Feb 17, 2023 at 9:02PM (UTC)
explorer-storybook ✅ Ready (Inspect) Visit Preview 💬 Add your feedback Feb 17, 2023 at 9:02PM (UTC)
frenemies ✅ Ready (Inspect) Visit Preview 💬 Add your feedback Feb 17, 2023 at 9:02PM (UTC)
wallet-adapter ✅ Ready (Inspect) Visit Preview 💬 Add your feedback Feb 17, 2023 at 9:02PM (UTC)

vercel[bot] avatar Feb 16 '23 12:02 vercel[bot]