Krishna Sridhar

We cannot distribute the 4-bit quantized model so we are working on making it such that you can create this yourself. Stay tuned!

We are actively working on Windows on Arm support. This is pretty important to us. Stay tuned.