lmdeploy icon indicating copy to clipboard operation
lmdeploy copied to clipboard

Published 20 hours ago • verified publisher icon InternLM

[Feature] Support vl models quantization

Open AllentDan opened this issue 1 month ago • 7 comments

  • [x] deepseek vl
  • [x] llava
  • [x] internvl
  • [x] xcomposer (did not quant plora)
  • [x] minigemini
  • [x] yi
  • [x] qwen
  • [x] internvl-llava

AllentDan avatar May 07 '24 10:05 AllentDan