ragas
ragas copied to clipboard
Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** I am trying to run the template code from the Github ReadMe page. My...
Does anyone know how to prompt data generation? I would need specific sentence structures. I tried to reconfigure the prompt itself, but it did not change the generated data sentence...
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** ValueError: a cannot be empty unless no samples are taken Ragas version:0.1.10...
[/ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. I integrated Langfuse with Ragas for evaluation purposes. Referring to issue #53, it's...
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** Getting "asyncio.exceptions.CancelledError" as an error Ragas version: Python version: 3.10 **Code to...
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. Is there a way to add a arg to testset generation that sets...
[x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. I want to create synthetic test data. Using the OpenAI or Anthropic API is very expensive...
ragas version 0.1.12 **Describe the bug** I try to run the demo with my openai key, which i have test my key is valid and i can get the correct...
**Your Question** Synthetic Test Data generation doesn't output columns ['answer'] as in this [Example](https://docs.ragas.io/en/latest/concepts/testset_generation.html#example) **Code Examples** ***Load Doc*** ```python from langchain_community.document_loaders import DirectoryLoader from ragas.testset.generator import TestsetGenerator from ragas.testset.evolutions import...
Getting exception when trying to generate test data with Bedrock and Anthropic claude2 combination
[Yes ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** A clear and concise description of what the bug is. Ragas version:...