llmops topic

🐢 Open-Source Evaluation & Testing for ML & LLM systems

Giskard-AI

ZenML 🙏: The bridge between ML and Ops. https://zenml.io.

zenml-io

The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!

bentoml

cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，server...

tencentmusic

Superduper: Integrate AI models and machine learning workflows with your database to implement custom AI applications, without moving your data. Including streaming inference, scalable model hosting,...

superduper-io

A fast and minimal framework for building agent-integrated systems

operand

LLM Prompt Injection Detector

protectai

BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

bionic-gpt

🧠 Motorhead is a memory and information retrieval server for LLMs.

getmetal

🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.

neurocult