PABannier
model quantize bad encodec
hi there, i'm not pretty sure if it a bug or i missed something in my quantization process but this is the result i have running the q4_0 model
this the code line i made for quantization
this is the running line
thank you for the project, it is really great and saves a lot of work!
Hello @Gabri94x ! Actually encodec.cpp is not quantized due to the minor gains it brings to this model. I'll have a look at the quantization for bark to make sure it works.
Yea I'm getting the same issue as well. It seems to occur with all quantization types, like q4_1, q8_0, etc.
Hello all! This should be fixed in #176 . Could you try again and let me know?
seems to be working now! now just new issues to address, like that the quantized models are slower than regular model. can probably close this issue now tho.