ragas icon indicating copy to clipboard operation
ragas copied to clipboard

Mistral-8x7b answer_correctness metric prompt fix

Open AlexisGitHu opened this issue 1 year ago • 1 comments

[X ] I checked the documentation and related resources and couldn't find an answer to my question.

Your Question Is there any prompt modification such that Mistral-8x7b does not give nan when evaluating answer_correctness metric?

Code Examples I do not have any code snippets as answer_correctness does not prompt any warning or message, it just outputs None.

Additional context The exact model I'm using is: mistralai/Mixtral-8x7B-Instruct-v0.1

AlexisGitHu avatar Mar 18 '24 09:03 AlexisGitHu

Have you tried setting the raise_exceptions parameter to True?

kanzyai-emirarditi avatar Apr 16 '24 20:04 kanzyai-emirarditi