n1ma Sh1

I suspect I've encountered a similar issue during training, but it requires further investigation. Above is my training loss. (Note: I simply replaced the transformer block in the MAE task...

请问一下您解决了吗

> @Sh1n1ma @Xijieupenn were you able to solve this? I just redownloaded the code and reinstalled it according to the readme document.And then it was okay. python 3.8.18 torch 1.12.0+cu113...

I've encountered the same issue, have you managed to solve this problem?