GlobalPointer_pytorch icon indicating copy to clipboard operation
GlobalPointer_pytorch copied to clipboard

Published 20 hours ago • verified publisher icon gaohongkui

是否可以训练出1024长度的模型

Open xxWeiDG opened this issue 1 year ago • 0 comments

您好，我看您采用了旋转式位置编码RoPE，是不是意味着可以训练出1024长度的模型呢？

xxWeiDG avatar Aug 29 '24 06:08 xxWeiDG