Costa Huang

Oh wow, didn't know this existed. Thanks @tristandeleu that really helps! My remaining concern is the wrappers. SB3 already has implemented a list of wrappers for the vectorized environment [here](https://stable-baselines3.readthedocs.io/en/master/guide/vec_envs.html#wrappers)....

If at all possible, could we try to unite the vectorized environment implementation @araffin @tristandeleu? They are all doing the same thing, and we should try to have a single...

@tristandeleu thanks for the well-considered reply. I completely agree with the first step being adding more documentations. Now that I was aware of the `single_observation_space` and `single_action_space`, it became much...

maybe helpful https://github.com/openai/lm-human-preferences/issues/17#issuecomment-1589680585

Maybe helpful https://github.com/openai/lm-human-preferences/issues/17#issuecomment-1589680585

Me please!