Antonin RAFFIN

If I use the env checker I get: ``` Traceback (most recent call last): File "/home/raff_an/USERDIR/projects/torchy-baselines/stable_baselines3/common/env_checker.py", line 219, in _check_returned_values _check_obs(obs[key], observation_space.spaces[key], "reset") File "/home/raff_an/USERDIR/projects/torchy-baselines/stable_baselines3/common/env_checker.py", line 164, in _check_obs ),...

Probably a duplicate of https://github.com/Stable-Baselines-Team/stable-baselines3-contrib/issues/74 and https://github.com/Stable-Baselines-Team/stable-baselines3-contrib/issues/80

Hello, you can have a look at the "automatic hyperparameter tuning" slides/video and notebook from https://araffin.github.io/tools-for-robotic-rl-icra2022/ See https://colab.research.google.com/github/araffin/tools-for-robotic-rl-icra2022/blob/main/notebooks/optuna_lab.ipynb you will to slightly update the code to use gymnasium instead of...

Hello, that's a good suggestion =) Would you mind giving it a try and check that you obtain the exact same results? If so, please open a PR ;) That...

Thinking again about that issue, I'm afraid we still need https://github.com/Stable-Baselines-Team/stable-baselines3-contrib/blob/25b43266e08ebe258061ac69688d94144799de75/sb3_contrib/common/recurrent/policies.py#L203-L204 to reset states manually when starting a new episode? (at least when updating the network, when calling `train()`) or...

Good point, in fact this is a recent addition to gym, this feature was missing for a long time, hence i was not using the make function.

Hello, Please fill in the issue template. Also, check that you are using the right VAE model.

Small update, I added CNN support for DQN: https://github.com/araffin/sbx/pull/49 I don't think separating fully features extractor and actor net would make sense for SBX.

This might be related to Jax not handling multi-threading/multi-processing well. You should probably have a look at distributed tuning using a shared database (I would recommend the log format): https://rl-baselines3-zoo.readthedocs.io/en/master/guide/tuning.html

> Why is that? I thought SBX is compatible with SB3. "[Stable Baselines Jax (SBX)](https://github.com/araffin/sbx) is a proof of concept version of Stable-Baselines3 in Jax. It provides a minimal number...