Lockinwize Lolite
Lockinwize Lolite
> So this may not related to my PR? Since the correctness on CPU indicates that the conversion is correct. I'm afraid not... This bug only appears when chatting with...
> Is the bug happening on LLaVA? Oh now I find that the `llava-cli` built in this PR even cannot load the model. It gave out the `unable to load...
> For now only tested on GPU env. CPU also the same. So it's quite confusing. Maybe you should update your branch? `llava-cli` in original llama.cpp repo (master branch) works...
@cmp-nct Hey cmp-nct, could you please help us resolve this confusing issue? Thanks a lot! I apologize if this has caused you confusion.