MiniGPT-4 icon indicating copy to clipboard operation
MiniGPT-4 copied to clipboard

Published 20 hours ago • verified publisher icon Vision-CAIR

我有两块16G的卡，请问想要项目支持多GPU是不是必须要自己重新训练模型？

Open chldong opened this issue 2 years ago • 0 comments

OutOfMemoryError: CUDA out of memory. Tried to allocate 12.00 MiB (GPU 0; 15.89 GiB total capacity; 14.38 GiB already allocated; 6.12 MiB free; 14.68 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

chldong avatar Apr 21 '23 01:04 chldong