assessor-scraper icon indicating copy to clipboard operation
assessor-scraper copied to clipboard

Published 20 hours ago • verified publisher icon codefornola

scraper takes too long to run

Open mrcnc opened this issue 7 years ago • 2 comments

Currently, on my machine with a 2.2 GHz i7 Processor, it's crawling ~600 pages/minute. Since there are ~165000 parcels, it will take ~4.5 hours to complete. This is too long and it would be a lot better if we could speed up this process.

mrcnc avatar Sep 21 '17 15:09 mrcnc