MIC icon indicating copy to clipboard operation
MIC copied to clipboard

Published 20 hours ago • verified publisher icon lhoyer

Memory issue

Open kimkj38 opened this issue 1 year ago • 1 comments

I use RTX 2080 Ti with 11GB memory but encountered CUDA out of memory. How much memory is needed per batch size 1?

kimkj38 avatar Oct 19 '23 07:10 kimkj38

when batch size=2, around 29G with fdthing=True, around 15G with fdthing=False

fuweifu-vtoo avatar Nov 04 '23 16:11 fuweifu-vtoo