CogVideo icon indicating copy to clipboard operation
CogVideo copied to clipboard
Published 2 months ago • verified publisher icon zai-org

position embedding

Open nankepan opened this issue 1 year ago • 1 comments

I noticed that position embedding is 3d_sincos_pos_embed, but the position embedding mentioned in the paper is rope. Will the code using rope be released?

nankepan avatar Aug 06 '24 10:08 nankepan

Better model will come soon

tengjiayan20 avatar Aug 06 '24 12:08 tengjiayan20