Yue Zheng

icon company Chongqing University of Posts and Telecommunications icon location Chongqing icon location Major in Control Science and Engineering.

Results 1 comments of Yue Zheng

self.ln_pre or self.ln_post？

Hello, why is self.ln_pre used here instead of self.ln_post? In def encode_text, self.ln_final is used, which represents the output layer_norm.