ggml topic

List ggml repositories

llama.cpp

89.6k
Stars
13.7k
Forks
89.6k
Watchers

LLM inference in C/C++

open-llm-webui

43
Stars
7
Forks
43
Watchers

This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).

tortoise.cpp

153
Stars
14
Forks
Watchers

A ggml (C++) re-implementation of tortoise-tts

whisper_ros

44
Stars
12
Forks
Watchers

Speech-to-Text based on SileroVAD + whisper.cpp (GGML Whisper) for ROS 2

AltaeraAI

43
Stars
0
Forks
43
Watchers

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

gguf.js

42
Stars
1
Forks
Watchers

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

llm_client

62
Stars
4
Forks
Watchers

An Interface for Deterministic Signals from Probabilistic LLM Vibes

project-zephyrine

19
Stars
1
Forks
Watchers

Introducing Project Zephyrine: Elevating Your Interaction Plug and Play, and Employing GPU Acceleration within a Modernized Automata Local Graphical User Interface.

pantry

21
Stars
0
Forks
Watchers

Actor based multi-llm registry + runner.

maid_llm

43
Stars
9
Forks
Watchers

maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)