Guangyi Zhang issues

Repositories
Issues
Comments

Results 1 issues of


                                            Guangyi Zhang

GPU Memory Exception(显存异常)

Hi, I encountered an abnormal memory usage issue when deploying Qwen2-VL-7B-Instruct using vllm. My specific configuration is as follows: (Hi,我使用vllm部署Qwen2-VL-7B-Instruct遇到了显存占用异常的问题。我的具体配置如下) ### Env(环境) ``` PyTorch version: 2.4.0+cu121 Is debug build: False...