hedera-mirror-node icon indicating copy to clipboard operation
hedera-mirror-node copied to clipboard

Bulk download record files to local storage

Open steven-sheehy opened this issue 2 years ago • 0 comments

Problem

We need start a mirror node from scratch to test historical downloader.

Solution

  • Use either a cli tool or bulk historical downloader to download at least 1/3 of signatures and a single deduped record file for mainnet data back to OA
  • Compress record files that are not already compressed
  • Process files with importer to ensure no issues and test import performance

Alternatives

No response

steven-sheehy avatar Oct 16 '23 04:10 steven-sheehy