Troyanovsky

Results 1 comments of Troyanovsky

First, the model size affects the resource use. 7B uses fewer resource than 13B. Then, the quantization method affects the resource use. 2Bit < 3Bit