RLzoo icon indicating copy to clipboard operation
RLzoo copied to clipboard

Does RLzoo support Dict gym env state?

Open GIS-PuppetMaster opened this issue 5 years ago • 2 comments

My customized gym env has a dict type obs_space, even I also customized ActorNetwork and CriticNetwork, I found out RLzoo's source code seems only support single input and can not handle dict state. Is there any plan to support dict gym env state?

GIS-PuppetMaster avatar Feb 02 '20 07:02 GIS-PuppetMaster

Hi, It supports dict state, but you need a wrapper for your env. Please take a look at the FlattenDictWrapper (./common/env_wrappers.py) for robotics env.

quantumiracle avatar Feb 06 '20 13:02 quantumiracle

Hi, It supports dict state, but you need a wrapper for your env. Please take a look at the FlattenDictWrapper (./common/env_wrappers.py) for robotics env.

Thanks, I think maybe supporting a preprocessing class like keras-rl is more flexible.

GIS-PuppetMaster avatar Feb 09 '20 14:02 GIS-PuppetMaster