HyRSM icon indicating copy to clipboard operation
HyRSM copied to clipboard

How to train on GPUs with restricted VRAM

Open luowyang opened this issue 2 years ago • 1 comments

It seems that the code cannot run on mid-end GPUs, such as NVIDIA RTX 2060s, without OOM. How can we modify the code to reduce the VRAM consumption per GPU?

luowyang avatar Nov 09 '22 06:11 luowyang

It seems that the code cannot run on mid-end GPUs, such as NVIDIA RTX 2060s, without OOM. How can we modify the code to reduce the VRAM consumption per GPU?

It is recommended that you can reduce the query number (i.e., "QUERY_PER_CLASS" in yaml file) to accommodate fewer computing resources. But the performance may be different from the default setting.

wangxiang1230 avatar Nov 11 '22 11:11 wangxiang1230