rl icon indicating copy to clipboard operation
rl copied to clipboard

[BUG] Tutorial #4, gym compat

Open maximilienleclei opened this issue 1 year ago • 1 comments

Describe the bug

The cell

from torchrl.envs import [GymEnv](https://pytorch.org/docs/stable/generated/torch.nn.Module.html#torch.nn.Module)

env = [GymEnv](https://pytorch.org/docs/stable/generated/torch.nn.Module.html#torch.nn.Module)("CartPole-v1", from_pixels=True, pixels_only=False)

print(env.rollout(max_steps=3))

from torchrl.envs import [TransformedEnv]

from tutorial # 4 (https://pytorch.org/rl/stable/tutorials/getting-started-4.html)

returns ModuleNotFoundError: No module named 'gymnasium.wrappers.compatibility' with gymnasium==1.0.0 & torchrl==0.5.0.

Reason and Possible fixes

If you know or suspect the reason for this bug, paste the code lines and suggest modifications.

Checklist

  • [x ] I have checked that there is no similar issue in the repo (required)
  • [x ] I have read the documentation (required)
  • [ x] I have provided a minimal working example to reproduce the bug (required)

maximilienleclei avatar Oct 15 '24 17:10 maximilienleclei

Hey! This seems to be due to gymnasium 1.0 which has many bc breaking changes. Unfortunately we do f intend on supporting that version and any further release of gymnasium until some concerns are addressed (see https://github.com/pytorch/rl/discussions/2483 and https://github.com/pytorch/rl/pull/2473 for context). Sorry about that

vmoens avatar Oct 15 '24 20:10 vmoens