ConnectionError when launch the model worker(s)

[sz2three]

when launch the model worker(s): python3 -m fastchat.serve.model_worker --model-name 'vicuna-7b-v1.1' --model-path /path/to/vicuna/weights it has error as follows: 2023-05-30 17:19:25 | ERROR | stderr | ConnectionError: HTTPConnectionPool(host='localhost', port=21001): Max retries exceeded with url: /register_worker 2023-05-30 17:19:25 | ERROR | stderr | (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fed5f8683a0>: Failed to establish a new 2023-05-30 17:19:25 | ERROR | stderr | connection: [Errno 111] Connection refused'))

[shad00m]

Same Issue here, any solution yet?

[David-Lee-1990]

solution？

[npuichigo]

same issue

[surak]

How do you run the controller?

[npuichigo]

In my side, when the request traffic increases, I god 502 error and find the same error in the log of model worker

[ruifengma]

I got exactly the same issue

[ruifengma]

How do you run the controller?

for me, I just simply run python3 -m fastchat.server.controller --host 0.0.0.0 --port 30001

[qroam]

Before this, you run

python3 -m fastchat.serve.controller --port 21001

to Launch a controller

Then, when run python3 -m fastchat.serve.model_worker --model-name 'vicuna-7b-v1.1' --model-path /path/to/vicuna/weights to load a model, it finds the controller by default at --port 21001

So, if your controller was not run at 21001, you should specify the fastchat.serve.model_worker where it is