lmdeploy icon indicating copy to clipboard operation
lmdeploy copied to clipboard
Published 1 month ago • verified publisher icon InternLM

[Docs] 支持量化压缩Intern-S1 和InternVL3_5-241B-A28B 吗?

Open tao-xiaoxin opened this issue 3 months ago • 2 comments

📚 The doc issue

如何量化压缩Intern-S1 和InternVL3_5-241B-A28B ?

Suggest a potential alternative/fix

No response

tao-xiaoxin avatar Sep 26 '25 03:09 tao-xiaoxin

Image同问，支持s1-mini么

fak111 avatar Oct 11 '25 07:10 fak111

InterVL3.5 fp8 量化可以尝试一下这个

https://github.com/InternLM/lmdeploy/pull/4018

其余量化方式目前可能存在适配问题，这边没有明确验证过能否成功

CUHKSZzxy avatar Oct 15 '25 13:10 CUHKSZzxy