mesa icon indicating copy to clipboard operation
mesa copied to clipboard

best practices / example for parameter sweep with batch runner

Open rlskoeser opened this issue 7 months ago • 15 comments

Are there any examples or best practices for doing parameter sweep type analysis with the batch runner?

I'd like to be able to do a large batch run with a number of varying parameters, and then run some analyses on the results - some across all variants, but also isolating specific runs where a single parameter varies.

I don't see any to get the parameters out of the batch runner so that I can figure out which runs where initialized with which parameters. Is this not yet supported? I think a simple csv of run id and parameters would be sufficient for the analysis I want to do.

I found this example of running a parameter sweep in a notebook, but it wasn't quite enough to get me to what I want to do: https://github.com/projectmesa/mesa-schelling-example/blob/master/analysis.ipynb

I also see there are some other open issues related to batch running and parameters, but I'm not sure how related they are to what I'm asking for. This one seems the most similar:

  • https://github.com/projectmesa/mesa/issues/382

rlskoeser avatar Dec 18 '23 23:12 rlskoeser