FRC: Retrieval Checking Requirements

[bajtos]

When we set out to build Spark, a protocol for testing whether payload of Filecoin deals can be retrieved back, we designed it based on how Boost worked at that time (mid-2023). Soon after FIL+ allocator compliance started to use Spark retrieval success score (Spark RSR) in mid-2024, we learned that Venus Droplet, an alternative miner software, is implemented slightly differently and requires tweaks to support Spark. Things evolved quite a bit since then. We need to overhaul most of the Spark protocol to support Direct Data Onboarding deals. We will need all miner software projects (Boost, Curio, Venus) to accommodate the new requirements imposed by the upcoming Spark v2 release.

This FRC has the following goals:

1. Document the retrieval process based on IPFS/IPLD.
2. Specify what Spark needs from miner software.
3. Collaborate with the community to tweak the requirements to work well for all parties involved.
4. Let this spec and the building blocks like IPNI Reverse Index empower other builders to design & implement their own retrieval-checking networks as alternatives to Spark.

RENDERED VERSION

Discussion

https://github.com/filecoin-project/FIPs/discussions/1086

Progress

• [x] Simple Summary
• [x] Abstract
• [x] Change Motivation
• [x] Specification
• [x] Design Rationale
• [x] Backwards Compatibility
• [x] Test Cases
• [x] Security Considerations
• [x] Incentive Considerations
• [x] Product Considerations
• [x] Implementation
• [x] TODO