Easy-Transformer icon indicating copy to clipboard operation
Easy-Transformer copied to clipboard

[Question] Why Gemma-2-2b would need 8GB VRAM?

Open notoookay opened this issue 9 months ago • 0 comments

Question

Hi, just curious. Why do gemma-2-2b and gemma-2-2b-it need 8GB VRAM even when I load it with bfloat16 or float16? I didn't find this on the other models like Qwen series.

notoookay avatar Apr 05 '25 14:04 notoookay