planetutils icon indicating copy to clipboard operation
planetutils copied to clipboard
verified publisher icon interline-io

Speed Improvement

Open nitrag opened this issue 5 years ago • 1 comments

This is probably not ready for an out-right merge but I want to bring it to you attention that it's possible to 10x the speed of tile downloads.

I'm able to achieve 450 tiles/sec (680Mbps) with this new method while downloading zooms 12, 13, 14 as separate commands. These stats are with an 8 CPU server, SSD (0% IO-Wait). So the limitation is my bandwidth.

Perhaps you want to incorporate this method into the larger download mechanisms.

nitrag avatar May 27 '20 19:05 nitrag

@nitrag thanks for this contribution. It can take a while to download a file planet's worth of terrain tiles, so it's a great idea to parallelize that.

We've got a number of other projects going so aren't able to work at the moment, but feel free to continue your PR and ping us when it's ready for a code review.

drewda avatar Jun 04 '20 22:06 drewda