llm-as-a-judge topic

List llm-as-a-judge repositories

CodeUltraFeedback

53
Stars
2
Forks
Watchers

CodeUltraFeedback: aligning large language models to coding preferences

LLM-IR-Bias-Fairness-Survey

39
Stars
3
Forks
Watchers

This is the repo for the survey of Bias and Fairness in IR with LLMs.

Timo

18
Stars
1
Forks
Watchers

Timo: Towards Better Temporal Reasoning for Language Models (COLM 2024)

prometheus-eval

767
Stars
47
Forks
Watchers

Evaluate your LLM's response with Prometheus and GPT4 💯

cobbler

15
Stars
1
Forks
Watchers

Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"

MJ-Bench

35
Stars
3
Forks
Watchers

Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"