course-nlp icon indicating copy to clipboard operation
course-nlp copied to clipboard

Update init of Transformer

Open bfarzin opened this issue 5 years ago • 0 comments

Adding init before training Transformer in the 8-Translation Notebook (with a note about why I did it in markdown.) Helps to train better, even without label smoothing.

bfarzin avatar Jul 19 '19 02:07 bfarzin