Sampreet

I'll resolve it while working on Off Policy Agents.

I'll work on Atari wrappers.

I'll do generic wrappers too if that's fine

Hmm... Okay. Should I also accommodate for classical models or only the deep models? Depending on that, I'll add a folder called wrappers (or) environments under genrl or genrl/deep.

Also, I think it would be a good idea to move VecEnv.py into this folder too. It makes more sense keeping it environments rather than in deep/common

Do we want pybullet and mujoco by v0.1?

Is this still an issue?

Hey, we've actually not tested it with newer versions of Pytorch as the project is currently inactive. Please try using torch 1.4.0 and see if it works. In case, you...

[This](https%3A%2F%2Fgithub.com%2Fopenai%2Fgym%2Fblob%2Fmaster%2Fgym%2Fwrappers%2Fmonitoring%2Fvideo_recorder.py) might be useful here.

Buffers have been tested but not after the addition of BCQ so tests are failing rn