Cornucopia-LLaMA-Fin-Chinese

Cornucopia-LLaMA-Fin-Chinese copied to clipboard

多gpu怎么运行啊

1

 我服务器8个gpu都是24G的运行报这个错误

longYGLlong

启动模型 bash ./scripts/infer.sh 异常

1

===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues ================================================================================ /home/ubuntu/miniconda3/envs/LLaMA/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: /home/ubuntu/miniconda3/envs/LLaMA did not contain libcudart.so as expected! Searching further paths... warn(msg) CUDA_SETUP:...

hy928302776

楼主用llama微调时，有没有遇到过回答即是提问的情况，请问知道什么原因么？

1

chenxu126

请问作者，微调后的模型，如何做效果的评估？

toughhou

如何运行推理？

1

基础模型下载了，lora也下载了，怎么运行推理呢？

hopeforus

hugface模型下载地址错误？两个都没有

3

hopeforus