llama-cpp-python topic

List llama-cpp-python repositories

oobabooga-macOS

60
Stars
9
Forks
Watchers

Optimizing performance, building and installing packages required for oobabooga, AI and Data Science on Apple Silicon GPU. The goal is to optimize wherever possible, from the ground up.

biniou

461
Stars
50
Forks
Watchers

a self-hosted webui for 30+ generative ai

TinyLLM

159
Stars
14
Forks
Watchers

Setup and run a local LLM and Chatbot using consumer grade hardware.

IALab-Suite

18
Stars
1
Forks
Watchers

Tool for test diferents large language models without code.

llama-cpp-chat-memory

29
Stars
6
Forks
Watchers

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

LLMinator

84
Stars
15
Forks
Watchers

Gradio based tool to run opensource LLM models directly from Huggingface

pytldr-oss

29
Stars
3
Forks
Watchers

An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intelligent assistant for modern professionals.