lmdeploy icon indicating copy to clipboard operation
lmdeploy copied to clipboard

[Docs] InternVL2-4B使用awq量化报错

Open Mrgengli opened this issue 1 year ago • 1 comments

📚 The doc issue

image InternVL2-4B使用awq量化报错,请问怎么解决呢?

Suggest a potential alternative/fix

No response

Mrgengli avatar Oct 05 '24 10:10 Mrgengli

降 transformers 版本吧,最新版的没法加载后保存 InternVL -4B 模型。

AllentDan avatar Oct 08 '24 02:10 AllentDan

This issue is marked as stale because it has been marked as invalid or awaiting response for 7 days without any further response. It will be closed in 5 days if the stale label is not removed or if there is no further response.

github-actions[bot] avatar Oct 17 '24 02:10 github-actions[bot]

PR #2583 is addressing this issue

lvhan028 avatar Oct 17 '24 07:10 lvhan028

This issue is marked as stale because it has been marked as invalid or awaiting response for 7 days without any further response. It will be closed in 5 days if the stale label is not removed or if there is no further response.

github-actions[bot] avatar Oct 25 '24 02:10 github-actions[bot]