Yingfan Tao

Hi, yy, I was wondering why you choose `xavier_normal_(self.weight, gain=2, mode='out')` instead of `nn.init.xavier_uniform_(self.weight)` when initializing weights. And by looking through the xavier_normal_ function, I found the weights won't participate...

self.t = target_logit.mean() * 0.01 + (1 - 0.01) * self.t

1

Hello! In the paper, t should be calculated as:  It seems to be "self.t = target_logit.mean() * 0.99 + (1-0.99) * self.t" in the code. But found "self.t =...