alvaroalfaro612

Bad quality in answers (repetition, non stop...) when using Llama3.1-8B-Instruct and Triton

3

### System Info - Running on containers on Linux server with GPU A5000 (24GB) ### Who can help? _No response_ ### Information - [X] The official example scripts - [...

FactualCorrectness false negative calculation

3

**Describe the bug** The calculation of answer_correctness metric (0.75*factual_correctness+0.25*semantic_similarity), does not use the same implementation of factual_correctness as when FactualCorrectness is computed directly. This discrepancy leads to inconsistent results in...