Add option to store and retrieve deltas

[urtho]

Status

Currently node stores a few deltas in memory only.

Expected

Node optionally stores deltas along with blocks and allows for retrieval from storage. This could be available only with PebbleDB compressed storage to not go beyond current full archival SQLite storage requirements.

Imagine a follower-less infra once dedicated archivers have this option enabled.

Urgency

Alognode.io built a dedicated pipeline and a block server just for that - to solve the jittery nature of the current conduit/follower pipeline.

https://github.com/AlgoNode/blocksrv https://github.com/AlgoNode/conduit-plugin-export-blksrv

[jannotti]

Are you wanting to keep the state delta for the entire block, or the detailed deltas for individual transactions?

[urtho]

My interest is just deltas for entire block - that is minimal requirement for conduit. Others are interested in TX deltas but that would probably blow up the storage requirements tenfold.