LlamaEdge

icon indicating a website link https://LlamaEdge.com/

icon location United States of America icon location The easiest, smallest and fastest local LLM runtime and API server. Creating cross-platform LLM agents and web services in Rust.

Results 1 repositories owned by LlamaEdge

rag-api-server

22
Stars
7
Forks
Watchers

A RAG API server written in Rust following OpenAI specs

verified publisher icon LlamaEdge