llm-ops topic
List
llm-ops repositories
OpenLLM
9.0k
Stars
574
Forks
49
Watchers
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
aiconfig
871
Stars
63
Forks
Watchers
AIConfig is a config-based framework to build generative AI applications.
friendli-client
36
Stars
5
Forks
Watchers
Friendli: the fastest serving engine for generative AI
ask-astro
159
Stars
37
Forks
Watchers
An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
athina-evals
140
Stars
11
Forks
Watchers
Python SDK for running evaluations on LLM generated responses
cognita
2.1k
Stars
167
Forks
25
Watchers
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
julep
261
Stars
6
Forks
Watchers
Open-source backend for building stateful AI apps