bsu3338

Results 23 comments of bsu3338

This was the command I used in the docker-compose file to launch the model entrypoint: ["python3.9", "-m", "fastchat.serve.vllm_worker", "--model-names", "openchat_3.5", "--model-path", "openchat/openchat_3.5", "--worker-address", "http://fastchat-model-worker:21002", "--controller-address", "http://fastchat-controller:21001", "--host", "0.0.0.0", "--port", "21002"]...

I just cloned the current main branch and rebuilt the docker image. I am still getting the same results.

What about if only one provider is configured then authentication is automatically redirected to it?