FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

ERROR | stderr | ERROR: [Errno 99] error while attempting to bind on address ('::1', 21002, 0, 0): cannot assign requested address

Open LIUKAI0815 opened this issue 1 year ago • 0 comments
trafficstars

代码: #!/bin/bash

启动控制器

python -m fastchat.serve.controller --host 0.0.0.0 --port 2002 &

为模型设置环境变量并启动

export CUDA_VISIBLE_DEVICES=1 python -m fastchat.serve.model_worker --model-path ./bge-large-zh-v1.5 --model-names gpt-4 --controller-address http://0.0.0.0:2002 &

启动openai服务器

python -m fastchat.serve.openai_api_server --host 0.0.0.0 --port 2003 --controller-address http://0.0.0.0:2002 &

LIUKAI0815 avatar Aug 13 '24 15:08 LIUKAI0815