Baichuan-13B icon indicating copy to clipboard operation
Baichuan-13B copied to clipboard

Published 20 hours ago • verified publisher icon baichuan-inc

最大长度能不能进一步增大？

Open runningBolin opened this issue 1 year ago • 2 comments

runningBolin avatar Jul 12 '23 02:07 runningBolin

chatglm2-6b用FlashAttention增大了context长度，百川有没有同样的计划？

runningBolin avatar Jul 12 '23 02:07 runningBolin

chatglm2-6b用FlashAttention增大了context长度，百川有没有同样的计划？

https://lmsys.org/blog/2023-06-29-longchat/

cbqin avatar Jul 12 '23 06:07 cbqin

感谢建议。我们会在后续迭代中关注long context问题

GradientGuru avatar Jul 18 '23 12:07 GradientGuru