IF-webui icon indicating copy to clipboard operation
IF-webui copied to clipboard

Published 20 hours ago • verified publisher icon niklasku

torch.cuda.OutOfMemoryError: CUDA out of memor

Open hicaoc opened this issue 1 year ago • 1 comments

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 16.00 GiB (GPU 0; 23.99 GiB total capacity; 7.31 GiB already allocated; 14.07 GiB free; 7.36 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

hicaoc avatar May 24 '23 03:05 hicaoc