dagstore
dagstore copied to clipboard
a sharded store to hold large IPLD graphs efficiently, packaged as location-transparent attachable CAR files, with mechanical sympathy
Haven't dived into the subdirectories yet.
Lotus Miners will delete the dagstore repo if they have to rollback for some reason. This means that retrieval deals will fail for the (storage deal with upgraded miner ->...
Go all in. Shard registrations, randomly removing existing Index files, clients not reading from response channels on purpose, registering shards with Mounts that occasionally hang, occasionally return corrupt CAR files,...
A more sophisticated alternative to #78 that uses https://pkg.go.dev/github.com/cenkalti/backoff/v4 to provide backoff behaviour.
Support two modes: - graceful: default mode, destruction is queued up until active acquirers release the shard. - forced: active acquirers are interrupted and the shard is forcefully released. In...
Some missing unit tests as of now. ## DAG store - [ ] Test slow registration with acquirers queued up. - [ ] Test slow registration without acquirers queued up....
Incubate it here, to then spin off to the Lotus repo upon integration of the DAG store there.