osrm-backend icon indicating copy to clipboard operation
osrm-backend copied to clipboard

Disk and Memory Requirements

Open raquelgdes opened this issue 6 years ago • 14 comments

Hi! I just want to use OSRM for routes in a country (Portugal), do I need the same requirements described here: https://github.com/Project-OSRM/osrm-backend/wiki/Disk-and-Memory-Requirements, or can I work with 4/16 GB of RAM?

raquelgdes avatar Nov 13 '18 13:11 raquelgdes

@raquelgdes 16 GB is OK to run on a France extract so it should be fine for Portugal too. Probably less would also do, given the OSM extract is much smaller. Your best bet is to try.

jcoupey avatar Nov 13 '18 13:11 jcoupey

Any estimate on what it would take to run N. America? Thanks

buildscientist avatar Nov 18 '18 20:11 buildscientist

Any estimate on what it would take to run N. America? Thanks

I processed entire North America (https://download.geofabrik.de/north-america.html) with 64 GB RAM and 4 cores. I tried with 32 GB first and end up getting not enough RAM error while running OSRM-contract

RamYadlapalli avatar Dec 28 '18 11:12 RamYadlapalli

I am having trouble finding a linux server hosting solution with this much ram thats not astronomically priced per year. You guys have any advice on a hosting solution?

mkallaoun avatar Nov 01 '19 22:11 mkallaoun

@mkallaoun There is no magic solution here - it's expensive to use this software on a large scale.

One suggestion: it takes significantly more RAM to process the data than it does to host it. As long as you keep the operating systems/machine architectures the same, you can rent a huge box for a short period to generate the routing files, then move them to a smaller box to actually perform route calculations on.

If query performance isn't super important to you, you can also look at the --mmap option of osrm-routed - this will "memory map" the datafiles and read parts of them off-disk on-demand. This slows down queries, but may be OK for your use-case. Typically, if you've got some hot spots where lots of routes are calculated, the filesystem cache will eventually have most of the important parts of the files in memory and queries can be reasonably fast.

danpat avatar Nov 01 '19 23:11 danpat

to much RAM sir.. i even can not try in my laptop :(

erlangparasu avatar Nov 28 '19 10:11 erlangparasu

@erlangp If you just want to try the software out, you can use a small country map extract from OSM, like Moldova. These only require a few 10s of MB of RAM.

danpat avatar Dec 02 '19 17:12 danpat

@mkallaoun Hetzner or OVH

systemed avatar Dec 04 '19 10:12 systemed

How did the osrm for Portugal on 16GB RAM work for you, @raquelgdes?

jfpalngipang avatar Jun 16 '20 03:06 jfpalngipang

Any estimate on what it would take to run N. America? Thanks

I did this with docker and it looks about 74Gb ram to preprocess and then about 36 to run the car profile.

kaushikray1 avatar Jul 04 '20 14:07 kaushikray1

any idea about how much time it will take for INDIA ANd resources required for that?

kaplgarg1 avatar Aug 19 '20 11:08 kaplgarg1

I am not sure as I didn't do it. I have the servers to run them email me at at [email protected] and may be I can generate the map files for you.

Get Outlook for Androidhttps://aka.ms/ghei36


From: kaplgarg1 [email protected] Sent: Wednesday, August 19, 2020 7:25:22 AM To: Project-OSRM/osrm-backend [email protected] Cc: Kaushik Ray [email protected]; Comment [email protected] Subject: Re: [Project-OSRM/osrm-backend] Disk and Memory Requirements (#5265)

any idea about how much time it will take for INDIA ANd resources required for that?

— You are receiving this because you commented. Reply to this email directly, view it on GitHubhttps://github.com/Project-OSRM/osrm-backend/issues/5265#issuecomment-676182985, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABGA5GWEXHVQS3VGNSPXSWDSBOZCFANCNFSM4GDOUT3Q.

kaushikray1 avatar Aug 19 '20 14:08 kaushikray1

Does anyone know the specs that the demo site is running on here?....https://map.project-osrm.org/

broomfn avatar Mar 03 '22 10:03 broomfn

you can get some ballpark numbers from https://github.com/Project-OSRM/osrm-backend/wiki/Disk-and-Memory-Requirements

nilsnolde avatar Mar 03 '22 11:03 nilsnolde