maid_llm
maid_llm copied to clipboard
maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
Would be neat if this supported llava models since seems some 7B RP models are starting to be able to do it e.g. https://huggingface.co/Lewdiculous/Eris_PrimeV3-Vision-7B-GGUF-IQ-Imatrix
Hi, are there any plans to add Google Gemma? Recently released versions works pretty well on LM Studio!
First of all thank you very much for open sourcing this project and maid. Would you provide documentation on how to integrate with any Flutter or dart application? Related to...
I found the crash occur on some low level API(
Hi, I imported the gguf file from [H20](https://huggingface.co/h2oai/h2o-danube3-4b-chat-GGUF/blob/main/h2o-danube3-4b-chat-Q4_K_M.gguf) and then tried to talk, the program exited abnormally I've tried both version 1.29 and 1.28 with this problem.