llm-evaluation-toolkit topic

Deliver safe & effective language models

JohnSnowLabs

Python SDK for running evaluations on LLM generated responses

athina-ai

A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.

Re-Align

Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

parea-ai

[ACL'24] A Knowledge-grounded Interactive Evaluation Framework for Large Language Models

zhuohaoyu