silkworm icon indicating copy to clipboard operation
silkworm copied to clipboard

History and Log Indexes

Open AndreaLanfranchi opened this issue 2 years ago • 2 comments

Rewrite and plug into syncloop of :

  • History Indexes
  • Log Indexes

These two stages have a lot in common (basically an index of roaring bitmaps) hence the implementation of IndexLoader in db\bitmap.hpp. The size of bitmap shards to insert in tables is now computed dynamically on behalf of MDBX's page size History index has two sub-stages : one for Account and one for Storage

AndreaLanfranchi avatar Sep 01 '22 10:09 AndreaLanfranchi

If you want we can wait another day and also tx lookup stage will be plugged in

AndreaLanfranchi avatar Sep 01 '22 10:09 AndreaLanfranchi

Codecov Report

Merging #743 (dd88123) into master (9004e9c) will decrease coverage by 0.60%. The diff coverage is 71.49%.

@@            Coverage Diff             @@
##           master     #743      +/-   ##
==========================================
- Coverage   76.31%   75.71%   -0.61%     
==========================================
  Files         190      193       +3     
  Lines       13057    13686     +629     
  Branches     2119     2185      +66     
==========================================
+ Hits         9965    10362     +397     
- Misses       2212     2410     +198     
- Partials      880      914      +34     
Impacted Files Coverage Δ
node/silkworm/stagedsync/common.hpp 58.82% <0.00%> (+21.32%) :arrow_up:
node/silkworm/stagedsync/stage_blockhashes.hpp 100.00% <ø> (ø)
node/silkworm/stagedsync/stage_senders.cpp 26.41% <0.00%> (ø)
node/silkworm/db/access_layer.cpp 80.10% <14.28%> (-0.74%) :arrow_down:
node/silkworm/stagedsync/stage_hashstate.cpp 47.03% <33.33%> (-1.44%) :arrow_down:
node/silkworm/db/util.cpp 74.13% <62.50%> (ø)
node/silkworm/stagedsync/stage_execution.cpp 30.63% <62.50%> (-0.47%) :arrow_down:
node/silkworm/stagedsync/stage_blockhashes.cpp 57.02% <64.00%> (+7.02%) :arrow_up:
node/silkworm/stagedsync/stage_tx_lookup.cpp 63.06% <64.02%> (-20.90%) :arrow_down:
node/silkworm/db/prune_mode.cpp 88.60% <66.66%> (-0.08%) :arrow_down:
... and 28 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

codecov[bot] avatar Sep 01 '22 10:09 codecov[bot]