MiniGPT-4 icon indicating copy to clipboard operation
MiniGPT-4 copied to clipboard

Published 20 hours ago • verified publisher icon Vision-CAIR

What is the minimum vram size to run the demo?

Open maciekpoplawski opened this issue 1 year ago • 1 comments

Hi! I would like to ask about min vram required tu run the demo. I tried to run it on 3090 but got: image Does cpu offloading may work?

Thanks in advance for reply

maciekpoplawski avatar Apr 17 '23 18:04 maciekpoplawski

Thanks for your interest! We update the demo hyperparameter setting and now it should run within 24 GB if you keep beam width as 1. You can refer to the updated readme for more information

TsuTikgiau avatar Apr 18 '23 19:04 TsuTikgiau