Question: L2 Distributed KVCache and Cross-Engine KV Reuse

[XiaozanZhang]

🚀 Feature Description and Motivation

Hello, L2 Distributed KVCache and Cross-Engine KV Reuse is it done by deploying Infinistore on each KvCache, and then managing Infinistore through the same KvCache watcher and Redis? because I noticed on the Infinistore GitHub that Infinistore does not support cluster mode

Use Case

Hello, L2 Distributed KVCache and Cross-Engine KV Reuse is it done by deploying Infinistore on each KvCache, and then managing Infinistore through the same KvCache watcher and Redis? because I noticed on the Infinistore GitHub that Infinistore does not support cluster mode

Proposed Solution

No response

[Jeffwan]

@XiaozanZhang infinistore itself doesn't support cluster mode but we use distributed hashing way to manage the multiple instances to form a cluster. We will soon release a new kv backend with better performance. We will share more details soon