Jiaxin Shan

Add two more issues to improve the lora observability. Let's remove stable label on this issue - https://github.com/vllm-project/vllm/issues/11090 - https://github.com/vllm-project/vllm/issues/11091

I used wrong endpoint here but even I use wrong one, does IPC connection helps? ``` - name: AIBRIX_LLM_KV_CACHE_RPC_ENDPOINT value: "aibrix-mode-deepseek-coder-7b-kvcache-rpc:9600" ``` It should be `deepseek-coder-7b-kvcache-rpc:9600`

em. the logs is kind of misleading. it complain the "Failed to connect to vineyard via both IPC and RPC connection". Technically, it should be able to connect to the...

@ying2025 v0.2.0 vineyard based distributed kv cache has some limitations. It requires both IPC and RPC server ready. Your above issue is similar to https://github.com/vllm-project/aibrix/issues/1012 you just created. it's more...

For this issue, the root cause is my careless, I used unmatched RPC Service name. User who deploy the kv cache server need to guarantee the correctness of the configuration....

Thanks for reporting the issue. Could I know your status of gateway service? ``` kubectl get svc -n envoy-gateway-system ```

This is incredibly helpful for diagnosing the issues. I believe we should provide more detailed installation guidance and include a dedicated documentation page for OpenShift environments.

indeed, aibrix replies on kuberay and we need an arm version as well. Let me make it today.

1. if you do not use kuberay, you can disable the kuberay validations. ``` containers: - name: manager args: - --leader-elect ..... - --health-probe-bind-address=:8081 - --metrics-bind-address=0 - --controllers=model-adapter-controller,model-route-controller,pod-autoscaler-controller,kv-cache-controller ``` >...

> 3.aibrix svc envoy-xxx extenal-ip is always pending and user port-foward to 80 port is also can't visit service please cut a separate issue with more details. the problem is...