Prahsant Patel

Vendor dir should not be commited.

1

Since you are using the dep as a package manager, shouldn't you be grabbing those dependencies during docker build? Vendor should not be committed, we can do `dep ensure` or...

**Describe what happened:** Makefile in included but, Readme is not comprehensive. **Describe what you expected:** In Readme I was expecting, build and run locally instruction. **Steps to reproduce the issue:**...

Complete layerwise implementation with Redis pipeline optimization for performance.

Layerwise remote

1

Key Changes Documented: 1. Configuration: Added layerwise remote options 2. Interface Extension: Extended RemoteConnector with layerwise methods 3. Redis Implementation: Optimized layerwise operations with async pipelining 4. Backend Integration: Added...

Improve KV cache storage performance and reliability

2

- Add exception handling around KV cache storage operations in vLLM adapter - Implement batched put operations in local CPU backend to reduce lock contention - Optimize storage manager to...

Fix async service cleanup in LocalBackend.close()

3

## Summary - Fixed critical resource cleanup bug in `LocalBackend.close()` that was causing service close methods to not execute properly when they were async - Made `LocalBackend.close()` async to properly...