BY571

Not able to run

3

Hello, when I try to run your code with the default arguments: `python main.py --expID 004 --td --bu --morphologies hopper` I get the following error: ` raise error.NameNotFound(message) gym.error.NameNotFound: Environment...

Hey, thank you for your work but sadly I'm not able to run your code I'm getting this inplace operation error. Weirdly that this only happens to me, I was...

Success rate plotting

1

Hey, thank you for the great work. I'm currently working with the Trifinger environment and wanted to ask if there is an easy way to add the success rate to...

[WIP] Hindsight Experience Replay Transform

8

## Description Adds Hindsight Experience Replay ([HER](https://arxiv.org/pdf/1707.01495.pdf)) Transform ## Motivation and Context The first draft for the HER transform. However, I am not sure if it should be a `Transform`...

[Algorithm] CrossQ

2

## Description Adding [CrossQ](https://openreview.net/pdf?id=PczQtTsTIX) ## Motivation and Context Why is this change required? What problem does it solve? If it fixes an open issue, please link to the issue here....

[Feature] Enable parameter reset in loss module

4

## Description Allows to reset the parameters in the loss module.

[Feature] AbsorbingStateTransform

2

## Description Adds AbsorbingStateTransform as used in the [DAC](https://arxiv.org/pdf/1809.02925) paper. ## Motivation and Context Why is this change required? What problem does it solve? If it fixes an open issue,...

[Algorithm] GAIL

1

## Description Add the algorithm Generative Adversarial Imitation Learning [GAIL](https://arxiv.org/abs/1606.03476) ## Motivation and Context Why is this change required? What problem does it solve? If it fixes an open issue,...

[BugFix] Target return for sequential td

16

## Description Target return calculation for sequential tensordict with time dimension did not work properly. ## Motivation and Context When using a sequential tensordict with time dimension (batch, time, feature)...

Hello! When fine-tuning my unsloth model using fast_inference=True. How can I update my LoRA weights manually, or are those weights getting updated automatically for the vllm_engine of my model? I...