RobustVLM icon indicating copy to clipboard operation
RobustVLM copied to clipboard

Published 20 hours ago • verified publisher icon chs20

About GPU memory requirements for model training

Open jiaxiaojunQAQ opened this issue 8 months ago • 1 comments

Thanks for your excellent work! I would like to ask how much memory is needed for training stage?

jiaxiaojunQAQ avatar Mar 26 '25 22:03 jiaxiaojunQAQ

Hi, we train the ViT-L/14 on 4x NVIDIA A100 40GB at total batch size 128

chs20 avatar Mar 27 '25 09:03 chs20