bsu3338
bsu3338
This was the command I used in the docker-compose file to launch the model entrypoint: ["python3.9", "-m", "fastchat.serve.vllm_worker", "--model-names", "openchat_3.5", "--model-path", "openchat/openchat_3.5", "--worker-address", "http://fastchat-model-worker:21002", "--controller-address", "http://fastchat-controller:21001", "--host", "0.0.0.0", "--port", "21002"]...
I just cloned the current main branch and rebuilt the docker image. I am still getting the same results.
What about if only one provider is configured then authentication is automatically redirected to it?