SlothRan

LLM的finetune需要多大的显存啊？为什么我batch__size调到了1,24g的显存还是不够。。。。。。。

2

报错：OutOfMemoryError: CUDA out of memory. Tried to allocate 128.00 MiB (GPU 0; 24.00 GiB total capacity; 23.13 GiB already allocated; 0 bytes free; 23.15 GiB reserved in total by PyTorch)...