transformer icon indicating copy to clipboard operation
transformer copied to clipboard

Published 20 hours ago • verified publisher icon Kyubyong

enc *= self.d_model**0.5 # scale

Open qwaiz opened this issue 5 years ago • 3 comments

It should be enc /= self.d_model**0.5

qwaiz avatar Sep 15 '19 08:09 qwaiz

i think so

Book1996 avatar Jul 03 '20 13:07 Book1996

Do you have revised this in your codes, and does this affect the results?

bozhenhhu avatar Jul 05 '20 13:07 bozhenhhu

thx a lot!

xiujiesong avatar Mar 22 '22 09:03 xiujiesong