llmon-py icon indicating copy to clipboard operation
llmon-py copied to clipboard

Local webui for Large Language Models. Supports the GGUF format. Inference LLMs with support for STT/TTS and function calling.

image

llmon-py is a WIP multimodal webui for inferencing Llama3-8B via text, voice and function calling.

image