llmops topic

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

DAGWorks-Inc

The Security Toolkit for LLM Interactions

protectai

A programming framework for agentic AI 🤖 (PyPi: autogen-agentchat)

microsoft

Tooling to build LLM applications: prompt templating and composition, agents, LLM memory, and other instruments for builders of AI applications.

zmedelis

LLMFlows - Simple, Explicit and Transparent LLM Apps

stoyan-stoyanov

Beginner-friendly repository for launching your first LLM API with Python, LangChain and FastAPI, using local models or the OpenAI API.

tleers

Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more

bentoml

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command...

promptfoo

GenAIOps with Prompt Flow is a "GenAIOps template and guidance" to help you build LLM-infused apps using Prompt Flow. It offers a range of features including Centralized Code Hosting, Lifecycle Manage...

microsoft

Large Language Models (LLMs) tutorials & sample scripts, ft. langchain, openai, llamaindex, gpt, chromadb & pinecone

onlyphantom