NovChopin issues

Repositories
Issues
Comments

Results 1 issues of


                                            NovChopin

[Bug]: When using the VLLM framework to load visual models, CPU memory overflow occurs while continuously processing data with images.

# The problem I encountered After deploying Qwen2-VL-7B-Instruct-GPTQ-Int4 using VLLM, continuous requests from clients will cause CPU memory to continue to rise. Is it because some memory has not been...

bug