KPConv-PyTorch icon indicating copy to clipboard operation
KPConv-PyTorch copied to clipboard

Published 20 hours ago • verified publisher icon HuguesTHOMAS

Why the cuda memory always change？

Open luzonghao1 opened this issue 3 years ago • 1 comments

Why the cuda memory always change？Do you have any way to pin the memory size？The server I use is public, and when others run the program, my program will run out of memory.

luzonghao1 avatar Jan 28 '22 01:01 luzonghao1

Hi @luzonghao1,

The reason the memory changes is because a lot of dimensions are variable, mainly the number of points in each batch. You can change a simple line so that the GPU always keeps memory allocated even if the next batch has fewer points. Just comment this line 👍 https://github.com/HuguesTHOMAS/KPConv-PyTorch/blob/73e444d486cd6cb56122c3dd410e51c734064cfe/utils/trainer.py#L203

An I think that should do it

HuguesTHOMAS avatar Jan 28 '22 15:01 HuguesTHOMAS