Pip install error with gym and torch

[BaleChen]

Hi, I encountered this error when pip installing the rl4lm library using pip install -e . The message says

'extras_require' must be a dictionary whose values are strings or lists of strings containing valid project/version requirement specifiers.

I found the solution to be first do pip install setuptools==65.5.0 pip==21, or even earlier versions according to this issue, though I suspect downgrading pip is not necessary.

As for torch=1.11.0, it is a relatively old package and seems to not support the latest version of Python. I didn't see you indicate your Python version so it would be nice to share it with everyone so that they won't encounter this dependency error. I downgraded from 3.11 to 3.8 and the error resolves.

Hope someone can have a look at this and see if it's my mistake or worth a PR.