tu

my `beta_end=0.07`, I ran everything the same as the notebook example.

I am running from the downloaded zip folder (**didn't** install via `pip install pytorchts`). Not sure if this affects anything.

I feel like its related to a random seed since we are using different machines....

pytorch 1.7.1+cu110

I tried with `pip install .`, nan still occurs, maybe you could update the results with **fixed seed** for pytorch,mxnet,numpy,random ... etc, and I will see if I can reproduce...

my cuda settings is like: `device = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")` but this is just because I don't have a GPU on `1`.

nothing works :/ I reinstalled everything in a clean env and still doesn't work. I installed `gluonts` via `pip install git+https://github.com/awslabs/gluon-ts.git@master#egg=gluonts`. If I try to install PyTorchTS via `pip install...

this would be a nice feature to have :100:

@lespeholt My TF version is 2.1.0 which is the same. I think my issue is with the grpc library as when I ran [this simple example](https://github.com/google-research/seed_rl/tree/master/grpc) I got the same...

@lespeholt > Do you right now use the prebuild .so file (i.e. you don't try to build the grpc library? yes, both seed_rl for r2d2 (without docker) using `python atari/r2d2_main.py...