evaluation-metrics topic

EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation

tanyuqian

A news recommendation evaluation framework

mjugo

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and Ca...

AgentOps-AI

Time-series Aware Precision and Recall for Evaluating Anomaly Detection Methods

saurf4ng

CERberus -- guardian against character errors :dog::dog::dog:

WHaverals

Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study

krystalan

:gift:[ChatGPT4MTevaluation] ErrorAnalysis Prompt for MT Evaluation in ChatGPT

Coldmist-Lu

Data-Driven Evaluation for LLM-Powered Applications

relari-ai

📝 Reference-Free automatic summarization evaluation with potential hallucination detection

Muhtasham

Framework for unified summarisation and evaluation of English documents using state-of-the-art models and measures.

webis-de