ragas icon indicating copy to clipboard operation
ragas copied to clipboard

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

Results 425 ragas issues
Sort by recently updated
recently updated
newest added

- [x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** I am using ragas for my application where i am calling ragas...

bug

I create a subclass of baseragassembeddings. because I already have all the embeddings for context, query, and question. I did this to not use the openai API key. because it...

question

- [x] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** The following error occurred NotImplementedError: adapt() is not implemented for answer_relevancy...

bug
question
module-metrics

- [x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Your Question** I would like to use Answer Relevance for RAG evaluation in Japanese. However,...

question

I have load pdf as document, now want to generate test data from it, error is occuring. --------------------------------------------------------------------------- ExceptionInRunner Traceback (most recent call last) [](https://localhost:8080/#) in () 4 ) 5...

bug
module-testsetgen
stale

Litmus is a comprehensive LLM testing and evaluation tool designed for GenAI Application Development. It provides a robust platform with a user-friendly UI for streamlining the process of building and...

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. I want to get all the intermediate steps performed while getting a metric...

question
module-metrics
answered

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** I wrote this code and I get the error: The api_key...

question
answered

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** I am using langchain for my agent. I have been able to...

bug

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** The answer generated by my model is similar to the ground_truths, but...

bug
module-metrics