cog-consistent-character icon indicating copy to clipboard operation
cog-consistent-character copied to clipboard

Published 20 hours ago • verified publisher icon fofr

12 GB of VRAM, not enough?

Open divid3byzer0 opened this issue 8 months ago • 1 comments

I am trying to run the model on Docker (Docker Desktop, Windows via WSL2) and my card is a RTX 4070 12GB, but I always see the error "torch.cuda.OutOfMemoryError: Allocation on device" and the predictions although they say "suceeeded", there are no output files.

I am guessing that the minimum for this model is 16 GB of VRAM?

divid3byzer0 avatar Jun 13 '24 23:06 divid3byzer0