Streamer-Sales icon indicating copy to clipboard operation
Streamer-Sales copied to clipboard

部署的问题

Open Zidoing opened this issue 9 months ago • 1 comments

你好,我在部署项目的时候,提示torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 112.00 MiB. GPU 0 has a total capacty of 11.72 GiB of which 63.81 MiB is free. Including non-PyTorch memory, this process has 11.41 GiB memory in use. Of the allocated memory 11.13 GiB is allocated by PyTorch, and 109.44 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

目前有3个问题想咨询一下

  1. 你开发的GPU设备是哪个,多少GPU显存。
  2. 这个项目多少GPU显存是最顺畅的。
  3. 目前我的显卡是4070 12G显存,如果要跑,是否有哪个地方可以尝试设置参数呢。

求教!感谢。

Zidoing avatar May 24 '24 02:05 Zidoing