IceTea42

terminal doesn't finish the inference

3

Hi, thanks for your work. I tried to run the inference by using the steps in the ReadMe, but my terminal gets stuck as if it was in an infinite...

Quantization

1

Hi, thank you for this work. How to quantize it to use int8? Any comments are appreciated.