taproot-assets icon indicating copy to clipboard operation
taproot-assets copied to clipboard

proofs+tarodb: stop storing proofs files in the DB switch to mmap access to on disk files everywhere

Open Roasbeef opened this issue 3 years ago • 1 comments

Today we store proofs in the DB, mainly for simplicity and to ensure we can atomically update proofs when we modify assets. IMO what we really want to do is only store them on disk, them use memory-mapping to access the proofs over contained memory regions. This means we minimize copying, and can pass around pointers in memory to the relevant mmap'd region. On top of this, we'll either want to maintain an external file w/ an index, or maintain the index within the database itself.

Roasbeef avatar Sep 27 '22 23:09 Roasbeef

"memory mapping the subdirectory" would enable the path be an S3 bucket

dstadulis avatar Nov 06 '23 20:11 dstadulis