IntptrMax

Will llama_kv_cache_seq_rm can help? When embding image/prompt, we can get n_past, will it can be recorded as the positison. (I could be wrong). `// Removes all tokens that belong to...

I have also tried to do it and have a very simple demo. I‘m trying to rewrite my code using llamasharp. The demo is like this: Prompt: describe the image...

@zsogitbe Thanks a lot! I have get the same problem when evaluating several images, that's a good idea to solve it.

I have tried to add llava to llamaSharp and it can work, but still have to improve. My demo is https://github.com/IntptrMax/LLamaSharp/tree/add_llava