FastChat
FastChat copied to clipboard
How can i access the API via IP address
i can curl http://localhost:8000/v1/chat/completions -H "Content-Type: application/json" -d '{"model": "vicuna-13b-v1.1", "messages": [{"role": "user", "content": "Hello!"}]}'
now i want to curl http://10.109.X.X:8000/v1/chat/completions -H "Content-Type: application/json" -d '{"model": "vicuna-13b-v1.1", "messages": [{"role": "user", "content": "Hello!"}]}'
. where should i change?
When running API server , try python3 -m fastchat.serve.api --host 0.0.0.0 --port 8000
instead of localhost
I think @ItsCRC is correct.