CUDA out of memory

[Ansveer]

Hello, it won't start, tried limiting VRAM consumption, nothing helped. What can I do? I tried to run it on an RTX 4060, Ubuntu 24.04 LTS

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 384.00 MiB (GPU 0; 7.63 GiB total capacity; 
6.34 GiB already allocated; 181.69 MiB free; 6.53 GiB reserved in total by PyTorch) 
If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.  
See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF