FastChat
FastChat copied to clipboard
Decoding errors on Windows when using GPU
When executing the command“”python -m fastchat.serve.model_worker --model-path E:\model\fastchat\model_weights\vicuna-7b, an error message as shown in the picture appears. Although the encoding configuration of PyCharm has been changed to UTF-8, the same error still occurs. However, when adding "--load-8bit" or "--device cpu" to the command, it can be executed normally. Can anyone please provide some guidance?