PTQ4ViT icon indicating copy to clipboard operation
PTQ4ViT copied to clipboard

Published 20 hours ago • verified publisher icon hahnyuan

量化模型的显存占用

Open Cascol-Chen opened this issue 1 year ago • 0 comments

请问该方法产生的8 bit量化模型，理想实现下在运行时能减少多少显存占用呢

Cascol-Chen avatar Jan 13 '24 11:01 Cascol-Chen