dagstore

dagstore copied to clipboard

Mount Instantiate func, uses `clone()` function to initialise new value of mount from registered type template. `clone()` func creates a copy of each field of mount and thats it. So...

walldiss

initializeShard lacks concurrency control

5

If I understand correctly, concurrency control is missing here. https://github.com/filecoin-project/dagstore/blob/1de8e01fd7d9ad5b297ecfb405dca1c3bea86d6f/dagstore_control.go#L103 It can cause the following situations: 1. If the scale of the storage cluster is large, the concurrency of initializeShard...

beck-8

Because Bitswap does not have a Start/Stop interface, and the Dagstore does not lock the d.shards map on startup, there can be a panic on concurrent read/write to `d.shards`. For...

distractedm1nd

In my dev environment, PersistedShard.URL contains some escape characters, like '%2F'. The whole URL is `file://%2Fhome%2Fricktian%2Fworkspace%2Flotus_dev%2Fcar%2Fbafk2bzaceddnvrk2uexrfib7yerhd754hw3ed2tfyvemkrpzflbyf2sbioswq.baga6ea4seaqbhygsit3b742jhtny3sjlznpjaevquj3unc4iugno6735z35hmny.car`, And this parse directory will cause error as follow: `2023-04-17T15:52:15.006+0800 WARN dagstore [email protected]/dagstore.go:572 failed...

ricktian1226

fix: `FileMount` should use url `Path` instead of `Host`

2

We [encountered a bug](https://github.com/celestiaorg/celestia-node/issues/2031) recently after switching from `FSMount` to `FileMount`. The root cause of the problem was the usage of the `Host` field of `url.URL` to store the file...

distractedm1nd

feat: `io.Reader` factory for `ShardAccessor`

1

At celestia-node, we don't only use `ShardAccessor`'s Blockstore to serve individual blocks, but also use the underlying mount to stream the CAR file to other full nodes. We do this...

distractedm1nd

Add support for deals using a data segment index

7

A deal may, rather than a single car, be a series of concatinated car files with a segment index at the end containing an inclusion proof. When such an index...

willscott

Bumps [github.com/ipfs/go-unixfs](https://github.com/ipfs/go-unixfs) from 0.3.1 to 0.4.3. Release notes Sourced from github.com/ipfs/go-unixfs's releases. v0.4.3 What's Changed sync: update CI config files by @​web3-bot in ipfs/go-unixfs#137 Full Changelog: https://github.com/ipfs/go-unixfs/compare/v0.4.2...v0.4.3 v0.4.1 What's Changed...

dependabot[bot]

For #134 . PR 1 for the Automated GC work. Upgrader should reserve and release allocations if the transient size is unknown before downloading a file from a remote mount...

aarshkshah1992

Automated Watermark based GC and Transient Quota allocation

4

This is a meta-issue to track the work of introducing an automated watermark based LRU GC of transients along with a quota reservation mechanism to allow for downloading transients whose...

aarshkshah1992