llama-cpp topic

List llama-cpp repositories

llama_dart

18
Stars
2
Forks
Watchers

Flutter / Dart bindings for llama.cpp

nlcli-wizard

20
Stars
2
Forks
20
Watchers

Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)

universal-intelligence

49
Stars
6
Forks
49
Watchers

◉ Universal Intelligence: AI made simple.

roleplay-ai

15
Stars
12
Forks
15
Watchers

This is the repository of an ai agent to role play with - currently based on llama.cpp or beam.cloud and finetuned mistral instruct v0.3

olla

119
Stars
12
Forks
119
Watchers

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

ComfyUI-MiniCPM

132
Stars
12
Forks
132
Watchers

A custom ComfyUI node for MiniCPM vision-language models, supporting v4, v4.5, and v4 GGUF formats, enabling high-quality image captioning and visual analysis.