SpinoPi comments

Repositories
Issues
Comments

Results 2 comments of


                                            SpinoPi

[Bug] InternVL3-14B-AWQ vllm部署报错 KeyError: 'layers.44.mlp.down_proj.qweight'

我也遇到了相同的问题，似乎是因为从nn.Module.named_parameters()得到的params_dict与模型实际的layer结构不匹配导致的。

Qwen2 VL cannot be convert to checkpoint on TensorRT-LLM

> Can try edit tensrrt-llm source: vim /usr/local/lib/python3.12/dist-packages/tensorrt_llm/models/qwen/config.py +146 ![Image](https://github.com/user-attachments/assets/bd65580d-b82e-41aa-9f1c-d4f3785cac6c) This does help. Thanks!