Some of the problems that occur in training

[Dyongh613]

Hi@keonlee9420, I encountered some problems during the training stage. I often have loss functions that occasionally fluctuate a lot during training, even from around 3 to tens or hundreds. After I set the training set shuffle, sometimes I have this problem, sometimes but not this problem. This problem was encountered in the naive, aux and shallow stages. Thank you for my friend！Best wish to you!

[Dyongh613]

By the way, it occurs on D_loss and adv_loss