magic-animate icon indicating copy to clipboard operation
magic-animate copied to clipboard

torch.cuda.OutOfMemoryError: CUDA out of memory

Open ulpcan opened this issue 1 year ago • 2 comments

Hi there I am getting

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 144.00 MiB (GPU 0; 7.77 GiB total capacity; 6.83 GiB already allocated; 46.81 MiB free; 7.17 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

Screenshot from 2023-12-07 16-35-05

command: python3.10 -m demo.gradio_animate

Am I not able to run code with Nvidia 3070 rtx?

ulpcan avatar Dec 07 '23 13:12 ulpcan

For now I think you need 12GB Vram minimum. Optimizations and half models will.probably come soon enough

Echolink50 avatar Dec 07 '23 14:12 Echolink50

Thank you for information then I should wait for optimizations

ulpcan avatar Dec 07 '23 14:12 ulpcan