mesa-geo
mesa-geo copied to clipboard
projectmesa
Performance and Scalability
Hi Can you give some tips on how to improve step performance for a large scale simulation?
Regards
/Imran
I am also looking for answers on the same. Is mesa-geo fine to work with large regions or populations, like few million agents simulating a country? Could you please let me know?
Thank you so much!
I have explored it deeply. It is very challenging to run even a 100 thousand agents with some basic features in this framework.
@imahmood786 Thank you so much for the response. Do you suggest a safe limit we can work with? Also, if there is any any alternative to this to work with large number of agents?
Hey, Did you guys figure out a way to handle a large number of agents? I'd be very grateful if you could let me know how to deal with a large number of agents if you figured out any.
With kindest regards, Harsh Panday
Sometimes, mesa-geo itself might not be the bottleneck. You can read the thread at https://github.com/projectmesa/mesa/issues/1185 for how to profile your code.
Thank you for the reply,
I didn't understand how I can store my agent attributes in a NumPy array.
I am adding my agents like this
ERHC = AgentCreator(erhc, {"model": self, "fa": 0})
agents_erhc = ERHC.from_GeoDataFrame(erhc_values, unique_id="id")
i=0
while(i<len(erhc_values)):
for agent in agents_erhc:
agent.longitude = erhc_data["longitude"][i]
agent.latitude = erhc_data["latitude"][i]
self.grid.add_agents(agent)
i = i + 1
self.schedule.add(agent)
The exact problem I am facing is that when I run the model with >8K agents, the MAP doesn't display any agents it's very unstable. https://github.com/Harshpanday/Store-Closure this is my repo with the code If you have time and want to take a look. I will be grateful for any suggestions.
The exact problem I am facing is that when I run the model with >8K agents, the MAP doesn't display any agents it's very unstable.
So the slowness happens only in the GUI? If you run without GUI, it is fast?
It runs as it's supposed to, but yeah the GUI is very slow, it takes the map 2-3 minutes to display the agents and when I zoom in or zoom out on the map the frames per second are also very low.
Maybe you should just smoothen out the agent circles into a heatmap. You can wait until #67 is merged, and add a layer that is computed from the circles density or something.
Some initial consideration on performances here: https://github.com/wang-boyu/agents-and-networks-in-python/pull/2
