GA3C icon indicating copy to clipboard operation
GA3C copied to clipboard

Need an action trigger for 'press to continue' kind of situations

Open yumere opened this issue 8 years ago • 1 comments

For some Atari games including Breakout, the environment sometimes waits for user input to continue (when the user looses a life, for example). Game play may be stuck forever if 'no-op' action is set in such situations. To prevent this, ProcessAgent may need an action sequence for repeated 'no-op' actions and should take an 'real' action if the queue length goes beyond the limit.

yumere avatar Feb 22 '17 01:02 yumere

This is a good feature to add but in our experiments it looks unnecessary. Usually the agent figures out the importance of pressing the fire button quickly enough and at the beginning it usually gets pressed by random (at least in case of Breakout).

mbz avatar Feb 24 '17 07:02 mbz