Stephanie Cao comments

Results 5 comments of


                                            Stephanie Cao

[Usage]: How do you setup vllm to work in k8s/openshift cluster

I'm seeing the same issue ``` python3 -m vllm.entrypoints.openai.api_server --model /model/model.file --port 8001 --trust-remote-code --gpu-memory-utilization 0.95: no such file or directory ``` any luck on this @jayteaftw ?

[Usage]: How do you setup vllm to work in k8s/openshift cluster

@jayteaftw I'm seeing RH has a ubi vllm image, and it does work for me, you might want to try this out as well. `quay.io/rh-aiservices-bu/vllm-openai-ubi9:0.4.2` it will help you download...

feat(deps): update to backstage 1.31

/lgtm lgtm from lightspeed-backend perspective

http:backstage:request action will throw out invalid plugin token error when call custom plugin

This error is also been seen due to the `ctx.secrets.backstageToken ` change: https://github.com/backstage/backstage/issues/25096 in addition, I have my proxy config set as following: ``` proxy: endpoints: '/gitlab': target: 'https://gitlab.com/api/v4' headers:...

http:backstage:request action will throw out invalid plugin token error when call custom plugin

> This action has set the Authentication header, but it is just to call the proxy plugin api. And I remember that for backstage proxy plugin, Authentication header will not...