Ruihan Xu

icon company Peking University icon location Beijing icon location CS Ph.D. Student at Peking University Research interest in neural architecture, computer vision

Results 1 comments of Ruihan Xu

Why does 2d tokens become 1d tokens and then become 2d tokens?

Because the LayerNorm is performed on the last dimension (which need 1d tokens) and Conv is performed on the last two dimensions (which need 2d tokens)