Seperate Evaluation for Retrieval and Generation both

[PrashantDixit0]

[ ] I checked the documentation and related resources and couldn't find an answer to my question.

Your Question How ragas can make it possible to evaluate retrieval and generation both separately with different metrics to analyse each of these step.

[sahusiddharth]

Retrieval Metrics

• Context Precision
• Context Recall
• Context Relevance

Generation Metrics

• Faithfulness
• Response Relevancy
• Noise Sensitivity
• Response Groundedness

Ragas also gives you options to make your own metrics using

• Aspect Critic
• Rubric Score
• Simple Criteria

[sahusiddharth]

We'll soon have this on docs as well, thanks to @KalyanKS-NLP.

[PrashantDixit0]

Thank you @sahusiddharth for responding. I also want to contribute in Ragas and other projects of Explodinggradients. Let me know how can I contribute 👍