llama-cpp topic

List llama-cpp repositories

LLamaSharp

2.5k
Stars
334
Forks
Watchers

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

LLMUnity

642
Stars
68
Forks
Watchers

Create characters in Unity with LLMs!

text-generation-docker

18
Stars
7
Forks
Watchers

Docker image for the Text Generation Web UI: A Gradio web UI for Large Language Models. Supports Transformers, AWQ, GPTQ, llama.cpp (GGUF), Llama models

ImpAI

53
Stars
3
Forks
Watchers

😈 ImpAI is an advanced role play app using large language and diffusion models.

llm-rp

28
Stars
2
Forks
Watchers

✨ Your Custom Offline Role Play with LLM and Stable Diffusion on Mac and Linux (for now) 🧙‍♂️

llama-playground

17
Stars
2
Forks
Watchers

A simple to use and powerful web-interface to mess around with Meta's LLaMA LLM.

llm-inference

69
Stars
17
Forks
Watchers

llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource...

llama.rn

238
Stars
20
Forks
Watchers

React Native binding of llama.cpp

llama-server

110
Stars
13
Forks
Watchers

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

llama-cpp-chat-memory

29
Stars
6
Forks
Watchers

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma