dessun888 comments

Repositories
Issues
Comments

Results 1 comments of


                                            dessun888

kagentsys chat with local llm error ,need to connect huggingface.co

nohup $PY_path/bin/python -m fastchat.serve.controller --host $IP >> ./serve.log & nohup $PY_path/bin/python -m fastchat.serve.vllm_worker --model-path /data/model/modelscope_hub/qwen/kagentlms_qwen_7b_mat --dtype half --controller-address http://$IP:21001 --trust-remote-code >> model.log & nohup $PY_path/bin/python -m fastchat.serve.openai_api_server --host $IP --port...