Relative-Uncertainty-Learning icon indicating copy to clipboard operation
Relative-Uncertainty-Learning copied to clipboard

Reproducing the results in different platform

Open wwzjer opened this issue 3 years ago • 1 comments

Dear authors,

thank you for sharing the codes of your nice work! However, when we tried the code, we found that the results are not very consistent on different platforms. Specifically, we made three trials (without any modification to the source code): [1] On a single GTX 1080Ti, the final accuracy is 88.85; [2] On a single RTX 3090, the final accuracy is 88.33; [3] On a single A40, the final accuracy is 88.62.

We are curious why this phenomenon happens. Also, we wonder if the authors could provide some suggestions on reproducing the results. Thank you!

wwzjer avatar Apr 25 '22 01:04 wwzjer

Hi. We think that completely reproducing the results are not guaranteed across PyTorch releases, different platforms or CPU/GPU executions, even when using identical seeds.

zyh-uaiaaaa avatar Apr 28 '22 09:04 zyh-uaiaaaa