exllama topic

List exllama repositories

llama-api

111
Stars
9
Forks
Watchers

An OpenAI-like LLaMA inference API

magi_llm_gui

40
Stars
4
Forks
Watchers

A Qt GUI for large language models

booster

137
Stars
6
Forks
Watchers

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

AI-Messenger

23
Stars
5
Forks
Watchers

A QT GUI for large language models

sliced_llama

17
Stars
0
Forks
Watchers

Simple LLM inference server