stable-baselines icon indicating copy to clipboard operation
stable-baselines copied to clipboard

add HER support for MultiDiscrete obs spaces

Open giorgionicola opened this issue 5 years ago • 1 comments

in her/utils.py Multidiscrete obsaervation spaces are not supported, is there an easy way to support them (obviously a part from translating it in a Discrete space)?

Is it planned to add Multidiscrete obs a spaces since DQN support them?

giorgionicola avatar Jan 31 '20 12:01 giorgionicola

Hello,

Is it planned to add Multidiscrete obs a spaces since DQN support them?

This is not planned as we are focusing on the v3.0 for now (and avoid adding new features). The current roadmap is defined here: https://github.com/hill-a/stable-baselines/milestone/4

is there an easy way to support them

As a quick fix, you can convert it to a Box space as a first approximation or even better, do the pre-processing (converting to one hot encoding) in the environment.

araffin avatar Feb 01 '20 19:02 araffin