lmops topic

List lmops repositories

BentoML

7.0k
Stars
781
Forks
Watchers

The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!

LMOps

3.6k
Stars
271
Forks
33
Watchers

General technology for enabling AI capabilities w/ LLMs and MLLMs

OpenLLM

9.8k
Stars
626
Forks
49
Watchers

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

bce-qianfan-sdk

318
Stars
48
Forks
Watchers

Provide best practices for LMOps, as well as elegant and convenient access to the features of the Qianfan MaaS Platform. (提供大模型工具链最佳实践,以及优雅且便捷地访问千帆大模型平台)