chenhr18thu
chenhr18thu
No relation to config.
@ultmaster This issue has troubled my team quite a lot. I search memory solutions in "pull request". I did not find the solution you mentioned. could you link that solution...
@ultmaster Thank you for your kind reply!
Thank you! The proposed solution works fine. The bug is from vllm, which is unexpected since we consider it as a mature framework.