AQLM icon indicating copy to clipboard operation
AQLM copied to clipboard

GPU OUT OF MEMORY

Open LiMa-cas opened this issue 6 months ago • 10 comments

image

torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 28.00 GiB. GPU 0 has a total capacity of 47.54 GiB of which 9.50 GiB is free. Process 1509125 has 9.68 GiB memory in use. Including non-PyTorch memory, this process has 28.30 GiB memory in use. Of the allocated memory 28.00 GiB is allocated by PyTorch, and 1.97 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables)

I think the GPU has enough memory since I used the image

LiMa-cas avatar Sep 04 '24 09:09 LiMa-cas