Ltryxcy

失效+1，ChatGPT网页不会显示插件了

> Can you explain a bit more what you mean by "each instance appears to allocate KV cache greedily"? From the screenshot, I can see kvcached allocates only the memory...

> ERROR: /tmp/pip-install-y6ja0vyp/kvcached_32ecdf44025a4bd5b524cceff3832c20/csrc/ftensor.cpp:75: Page 112 is already mapped. > ERROR: /tmp/pip-install-y6ja0vyp/kvcached_32ecdf44025a4bd5b524cceff3832c20/csrc/ftensor.cpp:75: Page 745 is already mapped By the way, I think this bug happens because when two models enable tensor...

> Thanks for bringing this up! > > Handling cluster-level bugs can be challenging. Could you please provide more details to help us diagnose the issue more easily? For example,...

> > > Thanks for bringing this up! > > > Handling cluster-level bugs can be challenging. Could you please provide more details to help us diagnose the issue more...

I followed your suggestions and reinstalled the latest version, but I'm still encountering the same issue during the `sllm-serve start` step. I suspect it might be a problem with the...

> We can now consistently reproduce this bug. If `pyarrow==17.0.0` is mistakenly installed in the **`sllm` environment** (instead of the `sllm-worker` environment), either explicitly or implicitly, the FCFS scheduler crashes,...