lusirisyoud

Results 1 comments of lusirisyoud

kv cache pool leak detected when benchmark llama13B-awq using A40

![1](https://github.com/sgl-project/sglang/assets/93562686/18ad7304-e14c-4f1a-9b73-32cfee61bc6b) ![2](https://github.com/sgl-project/sglang/assets/93562686/02107c18-3609-48da-aafb-218205a202f2) ![4](https://github.com/sgl-project/sglang/assets/93562686/05be823e-8290-44a7-9478-b61bbb109b3e) ![5](https://github.com/sgl-project/sglang/assets/93562686/6b14b14a-ce5c-4118-8d06-940a51e527c0)