David Himmelstrup

Stream CAR and CAR.zst files directly to the block store

1

**Issue summary** Forest prefers to download snapshots with `aria2c` for better download speeds in non-western countries. Unfortunately, using `aria2c` means we cannot stream data directly into our block store. Files...

**Issue summary** There are two kinds of data stores in Forest: Read-only CAR files and writeable ParityDB databases. Since all values are uniquely determined by their key, it does not...

On-demand multi-car indexing

1

**Issue summary** ForestCAR files offer `O(1)` look-up of IPLD values. Unfortunately, with more than one ForestCAR file, the look-up time grows linearly and quickly becomes prohibitive. One option is to...

**Issue summary** The entire Filecoin blockchain is stored in CloudFlare. With this data, we can do regression testing over arbitrary ranges of epochs. Regression testing is likely to be too...

**Issue summary** Forest stores diff snapshots (covering 3k epochs) and lite snapshots (every 30k epochs) in CloudFlare. This archive goes all the way back to genesis, and it should be...

Rate-limiting for the RPC API

1

**Issue summary** Lotus has a separate executable for providing safe access to their API. We could re-use their gateway executable to provide safe access to our API, but it would...

**Issue summary** Some tipsets around epoch 3141096 are slow to validate (10s to 30s on my rather powerful machine). This is quite a bit slower than the usual 1s-2s for...

Using hundreds of CAR files as a single block store is slow

3

**Issue summary** Multiple CAR files can be opened and joined into a single block store. This is convenient when using diff snapshots containing only the unique data generated over a...

Increase throughput of power-of-two formatting by 50%

1

大数你好, This change cuts the formatting time by a lot for large numbers when using a power-of-two radix. It's kinda ugly, though, so I'll try to find a better solution...