ragas

ragas copied to clipboard

Explicit the "Failed to parse output. Returning None." of RagasoutputParser or add a way to catch it.

4

**Describe the Feature** Hi @shahules786 @jjmachan, I'm back in Ragas business ^^ I've recently stumble upon a `Failed to parse output. Returning None.` while trying to evaluate the faithfulness of...

Gwenn-LR

I modified the prompts in RAGAs to create a knowledge graph and testset that suits my case, but how can I say that this is better?

6

- [x] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** what is unclear to you? What would you like to know?...

00dhkim

## 📋 Proposal I'm proposing to refactor the metrics module to create a clearer separation between core abstractions and specific metric implementations. ## 🎯 Motivation Currently, the `src/ragas/metrics/` directory mixes...

jjmachan

Feature: Optional Handit.ai integration to auto-fix prompts after Ragas evaluations

1

# Feature: Optional Handit.ai integration to auto-fix prompts after Ragas evaluations Hi team 👋 Love what you’ve built with Ragas — it’s become a go-to tool for evaluating LLM apps....

ccgomezn

Multi-threading processing error

1

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** When I used the evaluate() method to conduct multi-threaded evaluation of my...

jietang00723-cloud

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** The node types in the knowledge graph of ragas are relatively...

jietang00723-cloud

How can I evaluate image retrieval?

3

I've started using ColPali retrieval and would like to evaluate multimodal retrieval. Does Ragas support that?

simjak

Is Synthetic testset generation only possible through knowledge graph generation or is it possible to generate dataset without Knowledge graph as well?

3

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. My question is: Is it a possibility to generate Synthetic testset without knowledge...

saranyashalya

It takes two hours to evaluate two indicators with 500 data records. Is there any method to accelerate the evaluation?

2

It takes two hours to evaluate two indicators with 500 data records. Is there any method to accelerate the evaluation?

wangsir-cn

RuntimeError

5

Here is my result：  and my code： ``` import typing as t import asyncio from typing import List from datasets import load_dataset, load_from_disk from ragas.metrics import faithfulness, context_recall, context_precision...

minglong-huang