Troyanovsky
Results
1
comments of
Troyanovsky
First, the model size affects the resource use. 7B uses fewer resource than 13B. Then, the quantization method affects the resource use. 2Bit < 3Bit