Ovis icon indicating copy to clipboard operation
Ovis copied to clipboard

Published 20 hours ago • verified publisher icon AIDC-AI

If it is possible to run inference with OVIS 1.6 on a single 4090 GPU?

Open Raven625 opened this issue 5 months ago • 6 comments

Could anyone please advise if it is possible to run inference with OVIS 1.6 on a single 4090 GPU? After loading the model, it appears to consume approximately 20GB of VRAM. I attempted an inference, but the demo exited due to insufficient memory. Are there any solutions to this issue?

Raven625 avatar Sep 23 '24 06:09 Raven625