AlphaZero.jl icon indicating copy to clipboard operation
AlphaZero.jl copied to clipboard

Maximum number of iterations

Open StepHaze opened this issue 1 year ago • 1 comments

What maximum number of iterations have you done with AlphaZero.jl ? Please share your experience

StepHaze avatar Apr 17 '23 10:04 StepHaze

I personally have trained small games with up to 40 iterations but number of iterations is not a very interesting metric on its own. There is a tradeoff between doing a small number of iterations with a large number of simulated games each time and a large number of shorter iterations. As a rough approximation, I would say that the former is potentially more sample-efficient while the latter is more stable / easier to tune.

jonathan-laurent avatar Apr 23 '23 07:04 jonathan-laurent