ragas

ragas copied to clipboard

[x] I checked the documentation and related resources and couldn't find an answer to my question. **Your Question** Does the idea of generating questions based on personas originate from the...

xXFiEsTaDeAmOnXx

ValueError: No nodes that satisfied the given filter. Try changing the filter. occurs because the generate_personas_from_kg function in the ragas library is unable to find any nodes in the knowledge graph (KG) that match the specified filter criteria.

3

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** I am trying to generate **ragas testset** for numerous documents using ragas...

gshravendra

AttributeError when I try to use ContextRelevance, LLMContextPrecisionWithoutReference to evaluate the test dataset

3

**Describe the bug** I got an AttributeError: property' object has no attribute 'get' when I try to use evaluate() function to evaluate a dataset with ContextRelevance, LLMContextPrecisionWithoutReference metrics. It's working...

Haoyuxiaohan

Llama4 as Evaluator

1

**Describe the Feature** Llama4 is recently released and it is benchmarking as one of the best evaluators. **Why is the feature important for you?** With 10M of context window, I...

PrashantDixit0

How do I put ragas outputs into a clean JSON, like the JSON that I can get from the dashboard?

1

Hi. I want to extract the output results from the Ragas result object on my local machine. How do I do that?

AmirPoursaberi

**Description:** This PR adds a helper function to extract token usage from LLMResult or ChatResult, using the `Azure AI` response format returned by `LangChain`. **Key Changes:** - Added `get_token_usage_for_azure_ai` utility,...

GoncaloGuedes

Current implementation of find_indirect_clusters runs at exponential time because the depth-first search always explores every path in the graph. A kg w/ ~3000 relationships takes over 3 hours on a...

aubford

Multi-Modal Testset Generation

2

**Describe the Feature** Add support for multi-modal testset generation in RAGAS. While RAGAS currently supports multi-modal evaluation through MultiModalRelevance and MultiModalFaithfulness metrics, it lacks the ability to generate multi-modal test...

wabeg

[R-313] Adding more LLM/Embedding Providers

25

A running issue to get feedback on which LLM or Embedding Providers we need to add for you [R-313](https://linear.app/exploding-gradients/issue/R-313/adding-more-llmembedding-providers)

jjmachan

Corrected numerous typos in Markdown files.

7

Ragas is a great tool but the contents of the website can still be improved. I corrected typos and unified some names (like langchain, Langchain -> LangChain) in Markdown documentation...

ker2xu