Vivace_m

icon location https://haoxiongliu.github.io/

Results 1 comments of Vivace_m

vLLM stops all processing when CPU KV cache is used, has to be shut down and restarted.

> > this issue makes vllm impossible for production use > > At present, we have found a workaround and set the swap space directly to 0. This way, we...