ragas

ragas copied to clipboard

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** Is there an metric to measure the alignment between the Retrieved...

rookiedali

[x] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** How can I generate qa samples in parallel or concurrently to access...

tolgaerdonmez

Documents appears to be too short (ie 100 tokens or less). Please provide longer documents.

1

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** A clear and concise description of what the bug is. ValueError Traceback...

ananthanarayanan431

Answer_relevance value negative issue.

1

[ O ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** The answer_relevance value is coming out negative. ex. -0.001454476865077159 Ragas version:...

InhyeH

Duplicate Questions and Spelling Mistakes in Generated Testset

3

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** When using the TestsetGenerator from the ragas.testset module, I am encountering...

Jayashree-kalabhavi

**Describe the Feature** LlamaIndex and Langchain wrapped models are available for evaluation, Langchain contains a wrapper for vLLM but it is not the most up-to-date and has some issues. So...

MaximeSongIdris

Testset generation issue with ollama, gets stuck at Generating common concepts

6

[X] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** I am unable to create test data set, using Ollama models , it...

rajuptvs

ToolCallAccuracy returns score higher than 1.0

1

- [x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** If multiple tool calls match the reference call, the returned score can...

mpanasiuk-suplari

[x] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** In my project I aim to use both Factual Correctness and Answer...

ryszardtuora

I will be using context recall as an example as my team has been having issues with parsing errors. it seems that local models (here Gemma3 4b) react difrent to...

Sdegraauw