Andrija Sagicc

I have the same problem with ResCarta manifest https://milutinbojic.digitalna.rs/iiif/api/presentation/3/f77afd7c-334c-4c96-b962-b58775ca5044%252F00000001%252Fvilijam1%252F00000005/manifest it shows (Left) on their build and also on my nuxt app https://mirador-nuxt-example.vercel.app/iiif/zimskam ALTO files are in xml format on link...

Here is gguf Q5_K_M version that works on llama.cpp. Converted and tested today. Hope to see it soon on ollama. https://huggingface.co/Sagicc/granite-8b-code-instruct-Q5_K_M-GGUF Thank you for this great work!

If help for 8b-instruct model. After convert using `python3` llama.cpp/convert.py granite-8b-ins --outfile granite-8b-ins/granite-8b-instruct.bin --outtype q8_0 --vocab-type bpe --pad-vocab` got this err when start ./llama.cpp/main -m ./granite-8b-ins/granite-8b-instruct.bin `llama_model_load: error loading model:...

@mayank31398 I know just wanted to help with 8b-instruct. Thank you!