arecibo icon indicating copy to clipboard operation
arecibo copied to clipboard

Add API for generic data directory

Open winston-h-zhang opened this issue 1 year ago • 1 comments

This PR implements a minimal generic data directory for arecibo to read/write from. It is similar the the data directory used in Lurk. Besides the immediate need to have some way of managing witness/cross-term vectors for our MSM data analysis, there has been a need for this type of infrastructure for a while.

See, for example, https://github.com/microsoft/Nova/issues/270, which can build upon this PR. There is also https://github.com/lurk-lab/lurk-rs/issues/1086, which may need to move some of Lurk's caching logic into arecibo.

This PR doesn't intend to address all the issues of these PRs, but it would be nice to have the first increment of work streamlined into the codebase, so that we can slowly build up to a robust solution.

winston-h-zhang avatar Feb 20 '24 07:02 winston-h-zhang