flow-go icon indicating copy to clipboard operation
flow-go copied to clipboard

Badger -> Pebble DB M3: unblock pruning of Execution, Access and Verification data

Open j1010001 opened this issue 9 months ago • 2 comments

Note: ideally we use the locking framework as proposed in: https://github.com/jordanschalm/lockctx/blob/main/README.md Completing this milestone enables removal of dependency on Badger DB from Verification node.

Follower @zhangchiqing

  • [ ] Execution https://github.com/onflow/flow-go/pull/7262
  • [ ] Verification https://github.com/onflow/flow-go/pull/7262
  • [ ] Access https://github.com/onflow/flow-go/pull/7262
  • [ ] Collection https://github.com/onflow/flow-go/pull/7262

Common to all nodes - needed for completing DB migration to Pebble

Added scope (end of Apr) Follower:

  • [ ] Consensus Builder https://github.com/onflow/flow-go/pull/7262
  • [ ] Finalizer https://github.com/onflow/flow-go/pull/7262

Other:

  • [x] Persister https://github.com/onflow/flow-go/pull/7358

  • [x] ExecForkSuppressor - add evidence of error conditions to Pebble (@fxamacker ) https://github.com/onflow/flow-go/pull/7388

  • [ ] Deployment - Switching from Badger to Pebble (Dynamic bootstrap (preferred), spork, or Migration) https://github.com/onflow/flow-go/issues/7395

  • [ ] Protocol Data (Consensus Follower) https://github.com/onflow/flow-go/pull/7262

  • [ ] Documentation: https://github.com/onflow/flow-go/issues/7397

j1010001 avatar Apr 04 '25 15:04 j1010001

This item Libp2p Blocklist was completed by:

  • #7361
  • #7363

fxamacker avatar Apr 30 '25 17:04 fxamacker

code complete, closing pending code reviews for follower engine. Does not cover the code to perform the actual pruning, just gets the data in Pebble to enable pruning.

j1010001 avatar Jun 10 '25 22:06 j1010001

Closed by https://github.com/onflow/flow-go/pull/7794

zhangchiqing avatar Sep 11 '25 18:09 zhangchiqing