microsoft
local bitnet model don't have the same quality as online bitnet
It seems, the bitnet local model doesn't have the same quality as the online demo from microsoft site : https://bitnet-demo.azurewebsites.net/
What are the parameters for online demo model ? i seems the result is longer and more precise.
What parameters can i modify to have higher quality results on my local bitnet ?
Thank you.
which local model are you using? As for my understanding, the demo site is running the exact same model as provided here https://huggingface.co/microsoft/bitnet-b1.58-2B-4T-gguf
One thing just came into my mind is that, you may need a refined system prompt to get better response quality. The current default prompt is too simple.
