FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

python3 -m fastchat.serve.controller

Open yangzhipeng1108 opened this issue 1 year ago • 6 comments

2023-04-18 10:42:03 | INFO | controller | args: Namespace(host='localhost', port=21001, dispatch_method='shortest_queue') 2023-04-18 10:42:03 | INFO | controller | Init controller 2023-04-18 10:42:03 | ERROR | stderr | INFO: Started server process [119491] 2023-04-18 10:42:03 | ERROR | stderr | INFO: Waiting for application startup. 2023-04-18 10:42:03 | ERROR | stderr | INFO: Application startup complete. 2023-04-18 10:42:03 | ERROR | stderr | ERROR: [Errno 99] error while attempting to bind on address ('::1', 21001, 0, 0): cannot assign requested address 2023-04-18 10:42:03 | ERROR | stderr | INFO: Waiting for application shutdown. 2023-04-18 10:42:03 | ERROR | stderr | INFO: Application shutdown complete.

yangzhipeng1108 avatar Apr 18 '23 02:04 yangzhipeng1108

python3 -m fastchat.serve.controller --dispatch-method lottery 2023-04-18 13:58:22 | INFO | controller | args: Namespace(host='localhost', port=21001, dispatch_method='lottery') 2023-04-18 13:58:22 | INFO | controller | Init controller 2023-04-18 13:58:22 | INFO | stdout | --test-- 2023-04-18 13:58:22 | ERROR | stderr | INFO: Started server process [455] 2023-04-18 13:58:22 | ERROR | stderr | INFO: Waiting for application startup. 2023-04-18 13:58:22 | ERROR | stderr | INFO: Application startup complete. 2023-04-18 13:58:22 | ERROR | stderr | ERROR: [Errno 99] error while attempting to bind on address ('::1', 21001, 0, 0): cannot assign requested address 2023-04-18 13:58:22 | ERROR | stderr | INFO: Waiting for application shutdown. 2023-04-18 13:58:22 | ERROR | stderr | INFO: Application shutdown complete.

yangzhipeng1108 avatar Apr 18 '23 05:04 yangzhipeng1108

solved

yangzhipeng1108 avatar Apr 18 '23 06:04 yangzhipeng1108

how to solved? i met the same problem.

ccbond avatar Apr 19 '23 15:04 ccbond

Same here. Any solution?

generalsvr avatar Apr 22 '23 05:04 generalsvr

Same here. Any solution?

#432 maybe you can see this issue.

ccbond avatar Apr 22 '23 07:04 ccbond

Adding --host 0.0.0.0 may solve your problem.

qianlong0502 avatar Apr 25 '23 08:04 qianlong0502

--host 0.0.0.0 does seem to be solving the problem. maybe the instruction on the main page should be updated to include this solution: python3 -m fastchat.serve.controller --host 0.0.0.0

mpetruc avatar May 08 '23 19:05 mpetruc

2023-04-18 10:42:03 | INFO | controller | args: Namespace(host='localhost', port=21001, dispatch_method='shortest_queue') 2023-04-18 10:42:03 | INFO | controller | Init controller 2023-04-18 10:42:03 | ERROR | stderr | INFO: Started server process [119491] 2023-04-18 10:42:03 | ERROR | stderr | INFO: Waiting for application startup. 2023-04-18 10:42:03 | ERROR | stderr | INFO: Application startup complete. 2023-04-18 10:42:03 | ERROR | stderr | ERROR: [Errno 99] error while attempting to bind on address ('::1', 21001, 0, 0): cannot assign requested address 2023-04-18 10:42:03 | ERROR | stderr | INFO: Waiting for application shutdown. 2023-04-18 10:42:03 | ERROR | stderr | INFO: Application shutdown complete.

[Errno 99] error while attempting to bind on address ('::1', 21001, 0, 0): cannot assign requested address this error means Port number occupied ,kill 21001 port is ok Execute the following command to view the pid corresponding to the port number: sudo netstat -tunlp example:21001 pid 810758 sudo kill -9 810758

qiangtang2017 avatar Jul 14 '23 03:07 qiangtang2017

2023-04-18 10:42:03 | INFO | controller | args: Namespace(host='localhost', port=21001, dispatch_method='shortest_queue') 2023-04-18 10:42:03 | INFO | controller | Init controller 2023-04-18 10:42:03 | ERROR | stderr | INFO: Started server process [119491] 2023-04-18 10:42:03 | ERROR | stderr | INFO: Waiting for application startup. 2023-04-18 10:42:03 | ERROR | stderr | INFO: Application startup complete. 2023-04-18 10:42:03 | ERROR | stderr | ERROR: [Errno 99] error while attempting to bind on address ('::1', 21001, 0, 0): cannot assign requested address 2023-04-18 10:42:03 | ERROR | stderr | INFO: Waiting for application shutdown. 2023-04-18 10:42:03 | ERROR | stderr | INFO: Application shutdown complete.

| ERROR | stderr | INFO :ERROR ,Note, this is not an error and has no effect

qiangtang2017 avatar Jul 14 '23 03:07 qiangtang2017

Google Colab redirects localhost to the VM backend, using 127.0.0.1 solves the issue:

!python3 -m fastchat.serve.controller --host 127.0.0.1 --port 8000

ggcr avatar Jan 20 '24 12:01 ggcr