ragas

ragas copied to clipboard

[ERROR] [ragas.utils] [RagasID: a-fb6708849c364267bd4cfedcea81454f, App-Version: 0.2.14] [API_ERROR] Request failed. Status Code: 500, URL: https://api.ragas.io/api/v1/alignment/evaluation, Error Message: API Message: An internal server error occured means the alignment evaluation endpoint is crashing...

VishalSharma2103

This tutorial contains: - Introduces a systematic, data-driven approach to prompt optimization using NVIDIA metrics for efficient and robust evaluations. - Demonstrates the process through a case study with a...

sahusiddharth

[Y] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** A clear and concise description of what the bug is. Ragas version: 0.2.14...

ker2xu

Misleading documentation for "LLM Based Context Precision without reference"

2

[x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** A clear and concise description of what the bug is. I think the...

muhammadyaseen

Language of the Testset

1

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** Why the testset language is in english, also the references are...

cmilanes93

why await no support from demo

2

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** run demo in https://docs.ragas.io/en/latest/getstarted/evals/#evaluating-using-a-llm-based-metric Ragas version: Python version: 3.10 Ragas Version: ragas...

landhu

docs: agent metrics code examples improvement

1

Description This update refactors the provided examples incorporating the corresponding async blocks. The changes enable the code to be executed seamlessly without any further modifications. Key Changes: Asynchronous Functionality: Wrapped...

yesidc

Issues with await for language adapt

2

[ y] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** I run the code flow with the help documents bellow,but one error...

shawn-maxiao

**Describe the bug** Since the same cache key is used for every call (as generate_multiple calls generate in BaseRagasLLM), generate_multiple does not in face generate_multiple responses but returns the same...

Nicba1010

- [x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** ResponseRelevancy does not guarantee varied questions. This makes strictness effectively pointless. Ragas...

aabanic