ollama icon indicating copy to clipboard operation
ollama copied to clipboard

Published 20 hours ago • verified publisher icon ollama

Add Bitnet.cpp engine

Open qdrddr opened this issue 7 months ago • 2 comments

So we can run bitnet models https://github.com/microsoft/BitNet

qdrddr avatar Apr 18 '25 13:04 qdrddr

I am looking forward to this. I feel like this is what Ollama was made for.

This discussion has an interesting screenshot but not sure how real it is

https://huggingface.co/microsoft/bitnet-b1.58-2B-4T/discussions/7

Image

borja-rojo-ilvento avatar Apr 24 '25 23:04 borja-rojo-ilvento

什么时候支持啊？

running-frog avatar Apr 26 '25 10:04 running-frog

What other enginer are lut there for BitNet other than "cpp" or "AirLLM"?

BradKML avatar Jun 25 '25 04:06 BradKML

no progress on this ?

Masrkai avatar Sep 01 '25 13:09 Masrkai

https://github.com/ollama/ollama/pull/11218

qdrddr avatar Sep 07 '25 14:09 qdrddr

Great! Thanks for mentioning my pr. I am currently building for Linux! CPython builds to .so is longer than i thought....

Scratch2033Alt avatar Oct 25 '25 00:10 Scratch2033Alt

I am trying to integrate it as a backend for LocalAI: https://github.com/mudler/LocalAI.

On Fri, Oct 24, 2025 at 9:33 PM Scratch2033Alt @.***> wrote:

Scratch2033Alt left a comment (ollama/ollama#10337) https://github.com/ollama/ollama/issues/10337#issuecomment-3445343153

Great! Thanks for mentioning my pr. I am currently building for Linux! CPython builds to .so is longer than i thought....

— Reply to this email directly, view it on GitHub https://github.com/ollama/ollama/issues/10337#issuecomment-3445343153, or unsubscribe https://github.com/notifications/unsubscribe-auth/A3C6LRRQD4Z5ZF46PCARY4T3ZLAMDAVCNFSM6AAAAAB3NCMQ2KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTINBVGM2DGMJVGM . You are receiving this because you are subscribed to this thread.Message ID: @.***>

leonhardrocha avatar Oct 27 '25 16:10 leonhardrocha