llama_cpp_dart icon indicating copy to clipboard operation
llama_cpp_dart copied to clipboard

Issue while quering the model

Open nestorasgeorgiou88 opened this issue 2 months ago • 1 comments

Hi, I habe tried to use a model in gguf format But i get the below error.

❌ Failed to generate text: LLMToolkitException: No suitable engine found for model: /data/user/0/com.example.roast_excuse/app_flutter/Smol-Llama-v1-Q4_K_M.gguf (detected: InferenceEngineType.llama)

Any ideas? Thank you in advance.

nestorasgeorgiou88 avatar Nov 01 '25 22:11 nestorasgeorgiou88

I have updated to newest llama.cpp please try 0.1.2

netdur avatar Nov 09 '25 21:11 netdur