Billy Bao
Billy Bao
we are working on it.
@StupidWyh If you want to swtich stable releases, you can use `git checkout`, e.g. `git checkout v0.19.0`. Then delete previous docker images and compose again.
Please follow the instructions in the README. Simply check out the version you want to use. Also, when I suggested deleting the Docker image, I actually meant stopping and removing...
@Bob123Yang I currently don’t have the hardware required to run vLLM. Regarding the API-key field: if you are deploying a local model, you should leave it blank.
Since there has been no further activity for over three weeks, we will proceed to close this issue. If the problem persists or you have additional questions, please feel free...
you want a http api to achieve this?
You should edit service_conf.yaml not template.
Since there has been no further activity for over three weeks, we will proceed to close this issue. If the problem persists or you have additional questions, please feel free...
pull the latest code.
@ouyong-1 pull the latest code.