Easy-Transformer
Easy-Transformer copied to clipboard
[Question] Why Gemma-2-2b would need 8GB VRAM?
Question
Hi, just curious. Why do gemma-2-2b and gemma-2-2b-it need 8GB VRAM even when I load it with bfloat16 or float16? I didn't find this on the other models like Qwen series.