llm-as-a-judge topic
List
llm-as-a-judge repositories
CodeUltraFeedback
53
Stars
2
Forks
Watchers
CodeUltraFeedback: aligning large language models to coding preferences
LLM-IR-Bias-Fairness-Survey
39
Stars
3
Forks
Watchers
This is the repo for the survey of Bias and Fairness in IR with LLMs.
Timo
18
Stars
1
Forks
Watchers
Timo: Towards Better Temporal Reasoning for Language Models (COLM 2024)
prometheus-eval
767
Stars
47
Forks
Watchers
Evaluate your LLM's response with Prometheus and GPT4 💯
cobbler
15
Stars
1
Forks
Watchers
Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"
MJ-Bench
35
Stars
3
Forks
Watchers
Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"