Does this project require a lot of RAM and video memory resources?

[zhaofh1115]

Does this project require a lot of RAM and video memory resources? I'm using 11GB video memory, batch_size=2, and I get an error: CUDA out of memory. It only works when I set batch_size to 1. In addition, I trained with 3 gpus simultaneously, batch_size = 1, RAM of 32G, and after two epochs of training, the program was still killed by the system due to lack of RAM

[SlongLiu]

The Transformer arch is GPU-mem cost. You may need GPUs with more memory. For the RAM, it seems like 32GB is not enough. One way to alleviate this is to use small input images. We use max=1333 by default.

[zhaofh1115]

Ok, thank you for your reply

[zhaofh1115]

Could you please tell me how much memory this project needs to run at most?

[FengLi-ust]

Around 15G mem is enough for batchsize 2.

[zhaofh1115]

Sorry, I meant RAM

[lixing-can]

I also have this problem at present, it seems that 32G is only enough for the model to run three epochs. What is the minimum RAM required?

[meirashaf]

I also have this problem at present, it seems that 32G is only enough for the model to run three epochs. What is the minimum RAM required?

I don't know if this useful, but maybe for reference Optimizing Resource for training DINO