Ma Mana ma Manama

Note mostly to self: the newest `docling-parse` finally installs on Termux without git cloning and code changes (as compilation of this bit: `Building CXX object libqpdf/CMakeFiles/libqpdf.dir` , here: `Performing build...

Nota bene: adjust this number: `-D__ANDROID_API__=21` to your Android API version.

I could not make it run either. I have always had the same error ``` python setup_env.py -md ~/.cache/llama.cpp/microsoft_bitnet-b1.58-2B-4T-gguf_ggml-model-i2_s.gguf -q i2_s Traceback (most recent call last): File "/home/zezen/Downloads/BitNet/setup_env.py", line 232,...

Update, I have pasted also my musings to Grok and it (rightly methinks) claims that we are using the wrong GGUF files and are not isolating the pythons there. Grok...

Re: > Are you trying to convert the model by yourself? I'd suggest you download the model from HF and run it directly. Indeed, we may have been also trying...

Re: `git pull --recurse-submodules` - that newer version would be the most elegant if it would work with `https://huggingface.co/microsoft/bitnet-b1.58-2B-4T-gguf` that has puzzled us all, without virtualization or holding left ear...

Done git cloning anew. Instead of any `cmake` (does not work), I am trying as per the RTFM: `huggingface-cli download microsoft/BitNet-b1.58-2B-4T-gguf --local-dir models/BitNet-b1.58-2B-4T` and then ``` python setup_env.py -md models/BitNet-b1.58-2B-4T...

That: https://github.com/microsoft/BitNet/issues/206#issuecomment-2832035916 helped - it compiles. After a couple of `git reset --hard origin/main` type operations, however, deja vu: ``` build/bin/llama-server -m models/BitNet-b1.58-2B-4T/ggml-model-i2_s.gguf -c 2048 -t 2 -n 4096 --host...

Update: a note to myself mostly: doing the above on Droid this time. I have decoded what that setup_env.py file is doing. All the log output hidden by hard pipe...

FYi, after experimenting with the above, to clear up some PKG_CONFIG , LD_PATH like weirdnesses in my prooted Debian, it finally compiles and runs there, even the usual way. Yipee!