ragas
ragas copied to clipboard
explodinggradients
Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
**Your Question** I am using the following code for the evaluation of my dataset. I upgraded recently from 0.1.13 to 0.1.18 to use the new metrics ( noise_sensitivity_relevant, noise_sensitivity_irrelevant). But...
**What is the purpose of this code in function __create_statements_prompt_ at file __answer_correctness.py_?** ``` sentences = [ sentence for sentence in sentences if sentence.strip().endswith(".") ] ``` [ ] I checked...
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** My dataset here: {'question': 'what are you going', 'answer': "I'm going...
i am creating a testset using my nodes with below codes: ``` from ragas.testset.generator import TestsetGenerator from ragas.testset.evolutions import simple, reasoning, multi_context generator = TestsetGenerator.from_llama_index( generator_llm =llm_model, critic_llm = llm_model,...
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** can customize CORRECTNESS_INSTRUCTIONS and CORRECTNESS_PROMPT when evaluate answer_correctnes **Code Examples** I...
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** 【faithfulness.adapt(language="chinese") is no useful】 Ragas version:0.1.0 Python version: **Code to Reproduce** Share...
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** 【faithfulness.adapt(language="chinese") is no useful】 Ragas version:0.1.0 Python version: **Code to Reproduce** Share...
what is the code for llamaindex def generate_text( self, prompt: PromptValue, n: int = 1, temperature: float = 1e-8, stop: t.Optional[t.List[str]] = None, callbacks: Callbacks = None, ) -> LLMResult:...
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** Further request for LLamaIndex support regarding Azure OpenAI models (`from llama_index.llms.azure_openai import...
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** How can I customize data generation response of Data Generator class...
Metadata
Owner
Metadata
Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines