Antonin RAFFIN

> pybullet_envs -> no word on gym v0.26 yet, repo seems to have low activity (pybullet is no longer actively developed after all) Pull request is here: https://github.com/bulletphysics/bullet3/pull/4335 Pybullet is...

> pybullet_envs -> no word on gymv0.26 yet Bullet3 in progress ~we could activate the compatibility in the meantime, no?~ Nevermind, gym breaks pybullet by breaking changes in its registry...

> eyes how does Adan perform? Results are very preliminary, ADAN performs on par or slightly better than ADAM, but nothing significant yet. The noticeable difference is the FPS though...

@vwxyzjn Good news, I've got a TQC + SAC version working =) (currently doing some runs) @joaogui1 thanks, I gave distrax a try but it was giving me weird errors,...

Fyi, I converted that single file to a proof of concept of SB3 + Jax (SBX): https://github.com/araffin/sbx the nice thing is that I'm re-using SB3 base class, which means it...

Hello, have you considered using a Checkpoint callback or a custom callback ? ("alternatives" part in the issue template).

> checkpointCallback saves models every fixed steps and may save a bad model, if I understand correctly. yes, but if you set the save freq to be the same as...

Replying on the original issue: https://github.com/DLR-RM/rl-baselines3-zoo/issues/282

Hello, could you elaborate a little bit (and follow the custom env issue template by providing a minimal code example to reproduce the issue). Did you check your env using...

> then this is not the case for my environment, and I'll have to work around this. Easiest is to do a for loop (even though it will be slow,...