acme icon indicating copy to clipboard operation
acme copied to clipboard

Support specifying fill behavior in frame_stacking

Open ethanluoyc opened this issue 2 years ago • 0 comments
trafficstars

Add an option to allow for different frame_stacking behavior at the start of an episode.

Some original implementations of RL agents uses a different frame-stacking behavior at the start of the episode (repeat the first observation rather than zero pad). Add an option to support that. Keep the default to be the same zero-padding behavior to not break existing usage.

ethanluoyc avatar Feb 09 '23 11:02 ethanluoyc