GLM icon indicating copy to clipboard operation
GLM copied to clipboard
verified publisher icon THUDM

请教一下大家，glm0.3b有什么可用的推理加速的方法吗？目前我的推理任务要3秒钟一个，耗时太长

Open mechigonft opened this issue 2 years ago • 1 comments

mechigonft avatar Dec 22 '23 02:12 mechigonft

No description provided.

批量处理下

runningabcd avatar Jan 15 '24 12:01 runningabcd