vit-pytorch icon indicating copy to clipboard operation
vit-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon lucidrains

I doubled the batch size but GPU mem only increase 10%~20%, is it normal and why?

Open leviome opened this issue 3 years ago • 1 comments

as title

leviome avatar Apr 28 '21 06:04 leviome

It is very normal...Because the model itself has a notable memory footprint.

wuyongfa-genius avatar May 22 '21 07:05 wuyongfa-genius