jlsantiago

@pugafran The problem seems to be in LlamaSharp, but I don´t yet understand the reason. llama.cpp 1. I finetune the LlamaSharp example model: llama-2-7b-chat.Q4_0.gguf with an example dataset. 2. I...

@blueskyscorpio , Your problem seems to be different. You are trying to load a bin file not a gguf file that is the supported format. You need to load a...

I have a prototype working. I will see if I can clean and finish the project this weekend.

I will try to finish the library a little more this weekend before make this public. Until know, only tested on osx-arm64.

I have a branch in my fork with part of the changes. Build binaries, include runtime, etc. Those are things that I don't have done before. I first make the...

I will work this weekend to try to publish my work. The work will be in my branch: https://github.com/SignalRT/LLamaSharp/tree/MultiModal until PR.

The first PR to build llava binaries #556

If you don´t mind I would like to understand your use case. You have a ARM Mac and want to execute a docker with linux/amd64 platform so I suppose you...

I will try to run it in a container. I will give you feedback once I get some conclusions.

@AsakusaRinne We should think also on LLaVa (or more generic any multimodal model). Right now this is not managed by the llama.cpp libraries but with an additional library. Until now...