Mei Li
Results
4
comments of
Mei Li
trafficstars
> same on ubuntu, I can only get the token but not the model I am using ubuntu and it works well for me though.
Guess your torch version is too old?
Thanks for the tip @Maxpa1n It helped me a lot!
There must be something wrong on your side. 8bit quantization gives me decent result. Can you show your prompt and result?