FastChat
FastChat copied to clipboard
ERROR | stderr | ERROR: [Errno 99] error while attempting to bind on address ('::1', 21002, 0, 0): cannot assign requested address
trafficstars
代码: #!/bin/bash
启动控制器
python -m fastchat.serve.controller --host 0.0.0.0 --port 2002 &
为模型设置环境变量并启动
export CUDA_VISIBLE_DEVICES=1 python -m fastchat.serve.model_worker --model-path ./bge-large-zh-v1.5 --model-names gpt-4 --controller-address http://0.0.0.0:2002 &
启动openai服务器
python -m fastchat.serve.openai_api_server --host 0.0.0.0 --port 2003 --controller-address http://0.0.0.0:2002 &