ggml topic

List ggml repositories

booster

137
Stars
6
Forks
Watchers

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

demucs.cpp

88
Stars
12
Forks
Watchers

C++17 port of Demucs v3 (hybrid) and v4 (hybrid transformer) models with ggml and Eigen3

private-chatbot-mpt30b-langchain

182
Stars
43
Forks
Watchers

Chat with your data privately using MPT-30b

obsidian-local-llm

125
Stars
5
Forks
Watchers

Obsidian Local LLM is a plugin for Obsidian that provides access to a powerful neural network, allowing users to generate text in a wide range of styles and formats using a local LLM.

replit-3B-inference

155
Stars
28
Forks
Watchers

Run inference on replit-3B code instruct model using CPU

blitz-embed

15
Stars
0
Forks
Watchers

C++ inference wrappers for running blazing fast embedding services on your favourite serverless like AWS Lambda. By Prithivi Da, PRs welcome.

ImpAI

53
Stars
3
Forks
Watchers

😈 ImpAI is an advanced role play app using large language and diffusion models.

llm-rp

28
Stars
2
Forks
Watchers

✨ Your Custom Offline Role Play with LLM and Stable Diffusion on Mac and Linux (for now) 🧙‍♂️

stable-diffusion

34
Stars
5
Forks
Watchers

pure go for stable-diffusion and support cross-platform.

general_ai

343
Stars
1
Forks
Watchers

GENERAL Ai Library For DART & Flutter