async-rl icon indicating copy to clipboard operation
async-rl copied to clipboard

Do results differ only because of the seed?

Open danijar opened this issue 9 years ago • 0 comments

You write that one should try experiments with multiple seeds. Did you found that results differ substantially given only different seeds?

I'm asking because in the paper, Mnih. et al. take the best 5 out of 50 runs with different learning rates. However, from the paper it's not clear to me whether the methods are sensitive to the choice of learning rate or instable in general.

danijar avatar Aug 05 '16 21:08 danijar