Learneducn
Results
2
issues of
Learneducn
Hello, excuse me. When I follow the tutorial and use your script to convert the llama-2-7b-hf model, the following error always appears. I don’t know how to solve it. [root@localhost...
Currently we use a single GPU for decoding. We have the plan to support Multi-GPU decoding and the script is on the way. _Originally posted by @ddlBoJack in https://github.com/X-LANCE/SLAM-LLM/issues/100#issuecomment-2151660523_