llmon-py
llmon-py copied to clipboard
Local webui for Large Language Models. Supports the GGUF format. Inference LLMs with support for STT/TTS and function calling.
llmon-py is a WIP multimodal webui for inferencing Llama3-8B via text, voice and function calling.