qwq topic

List qwq repositories
trafficstars

grps_trtllm

157
Stars
11
Forks
157
Watchers

Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, d...

Sidekick

2.4k
Stars
78
Forks
Watchers

A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp...