Antonin RAFFIN

Hello @sushant1212 , thanks for the PR. As you are using master branch (and not a new branch), I cannot push edits to it... Also, please reformat **only** the code...

@ryanrudes could you test again? (there was a PyTorch release recently) And maybe test with PyTorch nightly build, it apparently works: https://github.com/DLR-RM/rl-baselines3-zoo/issues/267 I will update the `"auto"` device behavior in...

thanks @qgallouedec for the feedback =) We do need to wait for more coverage yes, issue is here: https://github.com/pytorch/pytorch/issues/77764

Hello, what you described sounds more like a feature request than a bug, hence I would ask you to fill up the feature request template ;) >In atari_wrappers.py, allow noop_max...

>I presume you mean that instead of line 238 there, I put in an if statement there that does not wrap with NoopResetEnv in case noop_max = 0. That does...

Hello, it doesn't seem that you are training the agent at all. We also recommend using `BreakoutNoFrameskip-v4` instead of `Breakout-v0`. If you want to have a working agent, please use...

I'm not sure what you tried, but if you follow the instruction on the page: ``` # Download model and save it into the logs/ folder python -m utils.load_from_hub --algo...

> I actually tried it but whenever I run that command I get this error: `C:\Users\shiva\AppData\Local\Programs\Python\Python310\python.exe: Error while finding module specification for 'utils.load_from_hub' (ModuleNotFoundError: No module named 'utils') you need...

@PartiallyTyped I thought about that one, and we just need to change the sampling not the storage, no? (as a first approximation) What I mean: at sampling time, we could...

A class that derives from the replay buffer class seems the natural option I would say.