celestia-node icon indicating copy to clipboard operation
celestia-node copied to clipboard

share: benchmark `Read/WriteEDS`

Open Wondertan opened this issue 1 year ago • 1 comments

Introduced #1104 and #1105 are allocations and CPU-intensive serialization functions. We should know how they perform and always have a starting point on where to improve further.

Wondertan avatar Sep 15 '22 14:09 Wondertan

A draft of optimizations tbd for WriteEDS:

  • [ ] Use sha256-simd
  • [ ] Use buffer pool for CAR allocations
  • [ ] Avoid copying the EDS
    • Write shares/samples at the moment of iterating

Wondertan avatar Oct 04 '22 10:10 Wondertan