llama_cpp_dart
llama_cpp_dart copied to clipboard
Issue while quering the model
Hi, I habe tried to use a model in gguf format But i get the below error.
❌ Failed to generate text: LLMToolkitException: No suitable engine found for model: /data/user/0/com.example.roast_excuse/app_flutter/Smol-Llama-v1-Q4_K_M.gguf (detected: InferenceEngineType.llama)
Any ideas? Thank you in advance.
I have updated to newest llama.cpp please try 0.1.2