ragas
ragas copied to clipboard
explodinggradients
Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** I am using the new @experiment decorator flow to evaluate a...
# PR Description This PR introduces a set of performance-focused changes across the Ragas codebase. The goal is to reduce unnecessary overhead in evaluation and sampling paths while keeping all...
# Pythonic Code Quality Improvements ## Summary This PR refactors the codebase to follow Python best practices, eliminating anti-patterns and improving code quality across 15 files. The changes focus on...
Merge when all `v0.4` changes are ready and updated.
**Context:** I am calling the evaluate function to calculate faithfulness and answer correctness. The dataset, which contains answer, context, question, and ground_truth, is passed as input. The evaluate function is...
**Describe the Feature** An option to print to PDF would help go over all the features of the package. **Why is the feature important for you?** Moving through pages makes...
[x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** [nest_asyncio](https://github.com/erdewit/nest_asyncio) has been archived by the owner for over a year now. This...
**Summary** This PR adds comprehensive support for evaluating agents that use the AG-UI (Agent User Interaction) protocol, enabling real-time evaluation of streaming agent interactions with support for tool calls, multi-turn...
In [doc](https://docs.ragas.io/en/latest/concepts/metrics/semantic_similarity.html ), > The concept of Answer Semantic Similarity pertains to the assessment of the semantic resemblance between the generated answer and the ground truth. This evaluation is based...
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** Unable to install NumPy. Ragas version: 0.3.4 Python version: 3.13 OS :...
Metadata
Owner
Metadata
Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines