FastChat python -m fastchat.serve.model_worker --model-path /data1/workspaces/llama2/Llama-2-7b-chat-hf --host 0.0.0.0

python -m fastchat.serve.model_worker --model-path /data1/workspaces/llama2/Llama-2-7b-chat-hf --host 0.0.0.0

Open alf-wangzhi opened this issue 11 months ago • 6 comments

Mar 26 '24 03:03 alf-wangzhi

这个问题最终解决了吗?

Mar 28 '24 02:03 liuainlp

i have the same problem , i dont know how to solve it for now...

Mar 28 '24 02:03 Spalatendoo

我也是没有解决这个问题

Mar 28 '24 04:03 liuainlp

我使用的代理连接的服务器然后加上了这句export no_proxy=192.168.1.0,localhost,127.0.0.1好使了

Mar 28 '24 04:03 alf-wangzhi

没明白您这个操作方法啊，代码没有问题对吧，是因为代理的原因哦

Apr 01 '24 04:04 liuainlp

Adding the worker and controller hostname to no_proxy or unsetting http_proxy and https_proxy resolved the issue for me.

Apr 10 '24 07:04 acylam