planetiler
planetiler copied to clipboard
[FEATURE] Can pass1 be re-sorted for pass2?
I am running on Windows, 32GB of RAM.
When generating tiles for say Canada (4GB), the generated node.db is 6GB and the OS auto memory-maps it correctly. During step2_ways I get 100-150k/s, and almost no HD activity.
But for the US (10GB), the generated node.db is 16GB, and for some reason the OS does not like that, during step2_ways processing is 2-5k/s, aka 30x-40x slower, and HD is at 100% usage.
Can node.db (or another copy of it) be pre sorted for the ways step? So the reads will be sequential and avoid the random read penalty?
Perhaps it makes sense to update docs that for good performance 1x-1.6x of RAM is required.
Thanks!