FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Decoding errors on Windows when using GPU

Open zlht812 opened this issue 1 year ago • 0 comments

image When executing the command“”python -m fastchat.serve.model_worker --model-path E:\model\fastchat\model_weights\vicuna-7b, an error message as shown in the picture appears. Although the encoding configuration of PyCharm has been changed to UTF-8, the same error still occurs. However, when adding "--load-8bit" or "--device cpu" to the command, it can be executed normally. Can anyone please provide some guidance?

zlht812 avatar Apr 26 '23 11:04 zlht812