llmops topic

An awesome & curated list of best LLMOps tools for developers

tensorchord

☁️ Build multimodal AI applications with cloud-native stack

jina-ai

Trustworthy Retrieval Augmented Generation (RAG) with Safeguards

safeguards-ai

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, a...

Josh-XT

AI Observability & Evaluation

Arize-ai

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

TransformerOptimus

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

bentoml

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-project

npm like package ecosystem for Prompts 🤖

sugarcane-ai

A reactive runtime for building durable AI agents

ThousandBirdsInc