aibrix icon indicating copy to clipboard operation
aibrix copied to clipboard
verified publisher icon vllm-project

Model adapter controller connect: Connection refused failed for /v1/models lora fetching.

Open Jeffwan opened this issue 1 year ago • 1 comments

🐛 Describe the bug

image

Let's follow up on how to better support such case.

Steps to Reproduce

No response

Expected behavior

No response

Environment

No response

Jeffwan avatar Nov 11 '24 08:11 Jeffwan

this issue only happens when we first release the pod, once the pod become healthy, it will disappear then. I move to future release and this is a low priority item

Jeffwan avatar Jan 20 '25 11:01 Jeffwan

https://github.com/vllm-project/aibrix/pull/1472 is merged to solve this issue

Jeffwan avatar Aug 30 '25 06:08 Jeffwan