Vincent Moens
Vincent Moens
@matteobettini there's a way to make vmap functional calls much much faster! we'll need to make sure this works across the board but if it does speed up could be...
## Description Describe your changes in detail. ## Motivation and Context Why is this change required? What problem does it solve? If it fixes an open issue, please link to...
Depends on https://github.com/pytorch/tensordict/pull/685
## Description When setting a ParallelEnv in a remote data collector and not embedding the env maker in an EnvCreator, an error is raised. This PR solves this issue.
This issue is a list of contributions requests from the community. ## How to use this list If you're willing to contribute to the library, have a look at the...
Loss functions accept non-tensordict data thanks to the tensordict.dispatch decorator. However, we do not provide an overloaded forward, which could be useful to let users know about the typical signature...
We project on using @tensorclass to represent losses. The advantage of tensorclass for losses instead of tensordict is that it will help us use all the features of tensordict while...
## Motivation In many scenarios we need to perform a step only on a subset of batched envs. This includes collecting a complete trajectory for many envs when they end...
## Description In this PR, I propose a script to run all our benchmarks before the release. cc @matteobettini @albertbou92 @BY571 @giadefa TODO: - [ ] make sure Wandb logging...
## Motivation Plan for the doc revamp - [x] A 0-to-1 tutorial or Getting started #861 - [x] A tutorial on building a custom env #911 - [ ] A...