aibrix
aibrix copied to clipboard
vllm-project
[Feature Request] Do you have a plan to add mooncake kvcache store as aibrix kvcache backend
🚀 Feature Description and Motivation
1 I want to use mooncake kvcache store as vllm kvcache store, I find your project aibrix kvcache connector is a good way to integrate with vllm kvcache management, 2 bug aibrix kvcache connector don't support mooncake kvcache store as backend 3 also i find there are many examples, like infinistore backend and mock connector as example 4 i still haven't enough confidence to make it
Use Case
1 use mooncake kvcache store as backend
Proposed Solution
No response
