huangb5760

v100 32g 单卡模型加载完成，对话报错RuntimeError: "addmm_impl_cpu_" not implemented for 'Half'

5

File "/home/ubuntu/anaconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl return forward_call(*input, **kwargs) File "/home/ubuntu/.cache/huggingface/modules/transformers_modules/Baichuan-13B-Chat/modeling_baichuan.py", line 370, in forward layer_outputs = decoder_layer( File "/home/ubuntu/anaconda3/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl return forward_call(*input, **kwargs) File "/home/ubuntu/.cache/huggingface/modules/transformers_modules/Baichuan-13B-Chat/modeling_baichuan.py", line...