Nils Kiele

[Tensorboard](https://www.tensorflow.org/tensorboard) is a tool for keeping track of and visualizing metrics during training. There's also [tensorboardx](https://github.com/lanpa/tensorboardX) which is platform agnostic. Tensorboard(x) is generally useful and might also come in handy...

Evaluation rework

6

*Description of changes:* This is an attempt of creating an alternative way to do evaluation. It is inspired by #1778 and only works on a limited number of use cases....

Inconsistent error definition

2

Currently, the meaning of _error_ doesn't seem consistent. Concretely, MSE uses `target - forecast.mean` as error while other metrics (absolute error, MAPE, ...) define the error as `target - forecast.median`....

## Describe the bug The [docstring](https://github.com/pytorch/rl/blob/b4b59444a5e894711ba6d062f9cddc6aafa0e095/torchrl/envs/transforms/transforms.py#L277-L287) of `Transform._call()` says it will be called by `TransformedEnv.step()` and `TransformedEnv.reset()`. However, resetting the transformed environment does not trigger `_call()`. ## To Reproduce ```python...