rl
rl copied to clipboard
A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
## Motivation An advantage of `TensorDict` modules, and in particular the `TensorDictSequential` is that they can write intermediate keys during their forward pass, which can then be reused. Say for...
## Description Refactor of the dreamer loss. WIP, TODO: forward function. ## Motivation and Context Requested by @vmoens per popular request ## Types of changes What types of changes does...
## Description Refactors collectors: - MultiSyncCollector can (and should) concatenate data along time dimension but the old behaviour is kept for consistency Because preemption now requires some reshaping, this could...
I am trying to parallelize [FourRooms](https://minigrid.farama.org/environments/minigrid/FourRoomsEnv/) minigrid environment using torchrl. Following is my code: ``` class MinigridGymWrapper(GymWrapper): """FARAMA Minigrid environment wrapper.""" git_url = "https://github.com/Farama-Foundation/Minigrid" libname = "minigrid" _make_specs = set_gym_backend("gymnasium")(GymEnv._make_specs)...
## Description This implements a reduction module for use with ensembles. ## Motivation and Context This relies on #1359 to make progress on https://github.com/pytorch/rl/issues/1344. - [x] I have raised an...
## loading error I've installed the module on Win11 by cloning it through pip, the installation was done successfully but I can't load the module because of Import Error: DLL...