WorldModelsExperiments
WorldModelsExperiments copied to clipboard
full episodes in extracting date
What's the reasoning behind using full 1000-frame episodes even when the game fails before 1000 steps? It seems to result in a lot of useless images (the ones after failure) in training.
There's no real reason apart from my laziness. You are free to do it in a more efficient way (and I recommend that you do so :)