MiniCPM-o icon indicating copy to clipboard operation
MiniCPM-o copied to clipboard

Published 20 hours ago • verified publisher icon OpenBMB

MiniCPM-V 2.6 int4 24G显存不够用，model.cuda()会OOM

Open MaxKinny opened this issue 5 months ago • 4 comments

文档说推理MiniCPM-V 2.6 int4只需要7GB，但我24G的OOM

MaxKinny avatar Aug 28 '24 06:08 MaxKinny