factuality topic

List factuality repositories

FActScore

274
Stars
40
Forks
Watchers

A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"

WikiChat

996
Stars
95
Forks
Watchers

WikiChat is an improved RAG. It stops the hallucination of large language models by retrieving data from a corpus.

factualNLG

58
Stars
3
Forks
Watchers

Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"

ExpertQA

119
Stars
13
Forks
Watchers

[Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers

DoLa

413
Stars
48
Forks
Watchers

Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"

fact-graph

46
Stars
5
Forks
Watchers

Implementation of the paper "FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representations (NAACL 2022)"

CHOCOLATE

23
Stars
0
Forks
Watchers

Code and data for the ACL 2024 Findings paper "Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning"

OpenFactVerification

1.0k
Stars
40
Forks
Watchers

Loki: Open-source solution designed to automate the process of verifying factuality

RefChecker

281
Stars
23
Forks
Watchers

RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Language Models.

long-form-factuality

529
Stars
58
Forks
Watchers

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".