VisualGLM-6B icon indicating copy to clipboard operation
VisualGLM-6B copied to clipboard

Published 20 hours ago • verified publisher icon THUDM

"addmm_impl_cpu_" not implemented for 'Half'

Open tzwo opened this issue 1 year ago • 1 comments

在回车后使用文本时，触发"addmm_impl_cpu_" not implemented for 'Half' 输入图像后触发："slow_conv2d_cpu" not implemented for 'Half'

tzwo avatar May 20 '23 13:05 tzwo

cpu不支持半精度的卷积等操作，需要在模型加载后增加 model=model.float() 全精度推理，不过会很慢。建议使用显卡

Sleepychord avatar May 20 '23 13:05 Sleepychord