sacred icon indicating copy to clipboard operation
sacred copied to clipboard

[Suggestion] Best way to make a parameter sweep?

Open Chutlhu opened this issue 5 years ago • 2 comments

Dear Sacred staff, First of all thank you very much for your work. It changed my PhD life. Second I would like to ask you what is the best way to implement a parameter sweep. May I create a bash script for each parameter/parameter configuration? Is there something already implemented? thank you very much

Chutlhu avatar Jun 11 '19 08:06 Chutlhu

Though not staff but rather community, you are probably looking for something like this https://github.com/IDSIA/sacred/issues/391#issuecomment-463554589. Basically, just iterate over your parameters and call ex.run for each configuration.

JarnoRFB avatar Jun 12 '19 06:06 JarnoRFB

I'm not sure there even is a staff?

I would recommend taking a look at the excellent ray.tune library. That's what I've been using and I know a few other people in the community are taking the same approach.

Here's some example code to get you started. The only slightly tricky thing is that experiments are not serializable so you have to be careful as to where you import it.

rueberger avatar Jun 12 '19 15:06 rueberger