llm-evaluation-toolkit topic

Deliver safe & effective language models

Pacific-AI-Corp

Python SDK for running evaluations on LLM generated responses

athina-ai

A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.

Re-Align

Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

parea-ai

[ACL'24] A Knowledge-grounded Interactive Evaluation Framework for Large Language Models

zhuohaoyu

An easy python package to run quick basic QA evaluations. This package includes standardized QA evaluation metrics and semantic evaluation metrics: Black-box and Open-Source large language model promp...

zli12321