Non-deterministic results in different runs

[sarahESL]

Thanks for publishing the code-base.

I noticed that in different runs, I get different results. It seems to be because of pytorch itself and setting torch.backends.cudnn.benchmark = False gives deterministic results in different runs. However, the performance drops by a few percentage. I was wondering whether you had noticed this and maybe report the average or max of different runs in the paper? If that is the case, how many time you ran the experiments?

Thanks in advance.