polygon-etl icon indicating copy to clipboard operation
polygon-etl copied to clipboard

Is it possible to speed up exporting receipts and logs

Open Vimdar opened this issue 1 year ago • 0 comments

Hi blockchain-etl team! I got a question - can I speed up somehow extractions of receipts and logs?

Setup: -polygonetl, version 3.4.2 (ran in a kubernetes pod with 3000Mi memory and 1500m cpu) -Querying own polygon archive as provider

Steps: -starting extraction with command polygonetl export_all -s, 19070000 -e 25069999

Outcome: -exporting receipts and logs takes >~90% of the time needed to extract info from a batch of blocks f.e. exporting 1000 blocks' transactions or ERC20 transfers takes <1 minute exporting the receipts and logs for the same batch of blocks takes ~1 hour

Expected: -is there any way I can speed this up?

I can provide more info, logs or whatever needed. Thanks!

Vimdar avatar Aug 23 '22 16:08 Vimdar