vit-pytorch
vit-pytorch copied to clipboard
I doubled the batch size but GPU mem only increase 10%~20%, is it normal and why?
as title
It is very normal...Because the model itself has a notable memory footprint.