llama-cpp topic

List llama-cpp repositories

llama-gpt

10.7k
Stars
694
Forks
Watchers

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

can-ai-code

518
Stars
29
Forks
Watchers

Self-evaluating interview for AI coders

CustomChar

94
Stars
9
Forks
Watchers

Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.

shady.ai

136
Stars
15
Forks
Watchers

Making offline AI models accessible to all types of edge devices.

langport

93
Stars
12
Forks
Watchers

Langport is a language model inference service

llama.go

1.2k
Stars
63
Forks
Watchers

llama.go is like llama.cpp in pure Golang!

booster

137
Stars
6
Forks
Watchers

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

llama-cpp-chat-completion-wrapper

25
Stars
1
Forks
Watchers

Wrapper around llama-cpp-python for chat completion with LLaMA v2 models.

maid

1.4k
Stars
152
Forks
Watchers

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

cortex

47
Stars
4
Forks
Watchers

Simplify and accelerate AI-powered application development with structured interfaces to models and powerful prompt execution environments.