BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard
Published 7 months ago • verified publisher icon microsoft

Results about others supported 1-bit models ?

Open lbarasc opened this issue 8 months ago • 2 comments

Do you test the others 1-bit models from Hugginface ?

bitnet_b1_58-large bitnet_b1_58-3B Llama3-8B-1.58-100B-tokens Falcon3 Family | 1B-10B

What are the results in inference ?

I personnaly use Falcon3-10B-Instruct-1.58bit.gguf and results are OK.

Please share your experience.

lbarasc avatar Apr 19 '25 13:04 lbarasc

https://huggingface.co/microsoft/bitnet-b1.58-2B-4T/discussions/4

werruww avatar Apr 20 '25 00:04 werruww

Image

sd983527 avatar Apr 22 '25 04:04 sd983527