llmops topic

Evaluation and Tracking for LLM Experiments

truera

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform ro...

uptrain-ai

No-code multi-agent framework to build LLM Agents, workflows and applications with your data

trypromptly

Friendli: the fastest serving engine for generative AI

friendliai

VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.

superlinked

⚡️ Transform AI/ML operations: Transparency, Control and Cost Optimization. ⚡️

NumexaHQ

An End to End GenAI Framework

aiplanethub

LLM Testing SDK that helps you write and run tests to monitor your LLM app in production

athina-ai

Finetune LLMs on K8s by using Runbooks

substratusai

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

predibase