Mrgengli

Results 11 comments of Mrgengli

[Bug] IntrenVL2-1B awq量化后推理异常问题

您好，我在使用0.5.3的lmdeploy对internvl2-4B进行awq量化的时候，最后保存模型的遇到了下面的问题，我想请问一下是怎么回事呢，麻烦大佬了。 ![image](https://github.com/user-attachments/assets/131caae5-80ff-44cf-8f33-80bfc40e4e8c)

[Bug] IntrenVL2-1B awq量化后推理异常问题

我在对 IntrenVL2-1B awq量化的时候遇到了相同的问题，请问是怎么回事呢？ ![image](https://github.com/user-attachments/assets/d581ddd6-0733-4436-a932-2fa1930920bc)

KeyError: 'architectures'

我在使用lmdeploy对internvl2-4B进行awq量化的时候也遇到了类似的错误 ![image](https://github.com/user-attachments/assets/71989e42-0f3b-4232-b89c-4b655a20835e)

KeyError: 'architectures'

@seongminp thank you very much ,my problems is solved.

[Bug] internvl 4B awq推理 Engine loop failed with error: module 'triton.language' has no attribute 'inline_asm_elementwise'

thanks for your reply! this is the env below: ![image](https://github.com/user-attachments/assets/f507b919-30cd-43bd-8ff7-e102337b839b)

[Bug] internvl 4B awq推理 Engine loop failed with error: module 'triton.language' has no attribute 'inline_asm_elementwise'

@AllentDan which is the right version please?i have tried deferent version,but other problem is happend. ![image](https://github.com/user-attachments/assets/318085be-4a01-4fc9-aed9-377368c871ce)

[Bug] internvl 4B awq推理 Engine loop failed with error: module 'triton.language' has no attribute 'inline_asm_elementwise'

@AllentDan I have correctly installed triton 2.3.0,but another error comes. ![image](https://github.com/user-attachments/assets/9b01d281-0d0f-41a8-aa15-9adf80f85e00)

[Bug] internvl 4B awq推理 Engine loop failed with error: module 'triton.language' has no attribute 'inline_asm_elementwise'

@grimoire I have successfully run triton_custom_add.py,but still got the same error. ![image](https://github.com/user-attachments/assets/559630c1-c5f5-4f09-95ba-63c3b3196368)

[Bug] internvl 4B awq推理 Engine loop failed with error: module 'triton.language' has no attribute 'inline_asm_elementwise'

@grimoire I have run custom_add and got the error below.could you tell me how to solve it please? ![image](https://github.com/user-attachments/assets/371c1adf-b87e-4c86-820a-c7dc1b726e43)

[Bug] internvl 4B awq推理 Engine loop failed with error: module 'triton.language' has no attribute 'inline_asm_elementwise'

@AllentDan hello,why I can not successfully pull the docker? ![image](https://github.com/user-attachments/assets/3a764408-3fc1-4579-b78e-eef01ba8f3a0)