Jiaxin Shan
Jiaxin Shan
move to later release due to limited times.
This has been supported in https://github.com/vllm-project/aibrix/pull/1132
I feel we need to change the design a little bit. 1. Lora replicas introduce hierarchy level, it's hard to manage everything in model adapter layer. status.phase etc can only...
this issue only happens when we first release the pod, once the pod become healthy, it will disappear then. I move to future release and this is a low priority...
https://github.com/vllm-project/aibrix/pull/1472 is merged to solve this issue
We have not cut any release against new organization yet. We will know once we cut v0.3.0-rc.1 release
- https://github.com/vllm-project/aibrix/pull/1085 - https://github.com/vllm-project/aibrix/pull/1084 After the fix, the release pipeline now is working fine.
> Currently, it is possible to distinguish whether a file has been downloaded through the metadata file under .cache/. However, it is impossible to distinguish whether the file is in...