concurrency with batches of blocks

Open joshstevens19 opened this issue 2 years ago • 1 comments

Right now on big block ranges, it loops through block by block to get the log information, with this block 2 will not be checked until block 1 has been checked; we should do some work to split up the range and run many tasks at once editing the from and to, we could just do this in the main.rs and keep the rest of the code as it is

Jul 04 '23 19:07 joshstevens19

have done this change local not super happy with it yet tbh but it does give a 20% speed increase awaiting my reth provider PR to be merged so i can get the provider in first then il come back to this

Jul 09 '23 00:07 joshstevens19