go-data-transfer

go-data-transfer copied to clipboard

Data transfer resumption for large data transfers exceeds message size limits

1

To support transfer resumption, a data-transfer requestor sends a Graphsync `DoNotSendCids` message to the responder with ALL the CIDs received so far. This solution does NOT scale as sending ALL...

aarshkshah1992

Return event but don't fail when encountering data of unknown encoding

1

There may be cases where the sending side of a data transfer encounters a block of data encoded with a codec that is not known to it. Currently, as it...

willscott

`go-statemachine` dosen't process additional events till this state handler function executes. We should do the cleanup in a go-routine.

aarshkshah1992

Enabling deduplication when retrieving overlapping selectors

7

I have observed when I execute multiple transfers with the same root and different selectors, overlapping blocks are re-transferred. This means clients may pay for the same blocks multiple times....

tchardin

This updates graphsync and removes transfer queued event, since now incoming requests ALWAYS get processed immediately (meaning you don't need to wait to get the Open event) Shouldn't be merged...

hannahhoward

investigate low performance and CPU hotspot transferring 4GiB over loopback

14

This is an initial observation from running the [Whitenoise tests](https://github.com/raulk/whitenoise) with a perfect network and no interruption rate, over the loopback interface. In other words, these are ideal conditions for...

raulk

[WIP] Feat/debug accept message error

1

To help debug the missing `Accept` messages on dealbot clients.

aarshkshah1992

Handle error properly when graphsync request's context is cancelled

1

handle https://github.com/filecoin-project/go-data-transfer/blob/master/transport/graphsync/graphsync.go#L185-L191 properly this might be the cause for https://github.com/filecoin-project/lotus/issues/6273 where the client-side is not getting the `Complete` message back from the miner

jennijuju

Update go-ipld-prime dependency

2

This library currently depends on go-ipld-prime v0.5, and due to breaking changes in the interface will not work with versions above v0.7. The current is v0.9. ``` [email protected]/encoding/encoding.go:30:10: undefined: dagcbor.Encoder...

willscott

racy connection management makes channel stall

2

Running the whitenoise tests and using an interruption policy of `0.2/1s` (20% probability that the connection will be interrupted every 1s), the opening of the push channel seems to block...

raulk