Negative Loss, Zero Success and Zero AoC

[bit0123]

Hi, Thanks for the interesting paper and releasing the code. I am facing the same issue ("TypeError: h5py objects cannot be pickled") while running with num_worker=4. However, the code works when i set num_worker=0 with some additional transformation of input image in the policy file.

The loss becomes negative after the first epoch for different algorithm with 0 success. Consequently, the AoC is 0. Could you please comment on that. Thanks