hibukipanim

[Bug]: with `--enable-prefix-caching` , `/completions` crashes server with `echo=True` above certain prompt length

16

### Your current environment ```text vLLM 0.4.3 RTX 4090 24GB (reproduces also on A100) ``` ### 🐛 Describe the bug Hi, When server started with: ``` python -m vllm.entrypoints.openai.api_server --model...

[Bug]: prefix-caching: inconsistent completions

22

### Your current environment ```text vLLM version 0.5.0.post1 ``` ### 🐛 Describe the bug Hi, Seems that there is a dirty cache issue with `--enable-prefix-caching`. We noticed it as we...