ragas

ragas copied to clipboard

avaialble -> available

eltociear

Improve JSON format prompt for large chunks & Handle ZeroDivisionError

1

## Description In this PR there are three different changes ## Changes 1. Fixed a Typo in the filter_question_prompt Instruction from `Asses` to `Assess` 2. Added a try-except block for...

Manav916

erorr on windows

5

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. i ran following code of ragas on windows 10 Ragas version: 0.1.4 Python version: 3.9...

frischzenger

Evaluating results in languages other than English

22

Ragas version: 0.0.22 Python version: Python 3.11.7 Can ragas correctly evaluate results in other languages? It seems that fully correct answers receive quite low scores. E.g. ``` Query: Ile kosztuje...

gitrid

In ragas 0.1.8 in _context_relevancy.py ```python async def _ascore(self, row: t.Dict, callbacks: Callbacks, is_async: bool) -> float: assert self.llm is not None, "LLM is not initialized" if self.show_deprecation_warning: logger.warning( "The...

abetatos

Testset Generation: Is going into continuous loop

22

**Question** I am not sure, what's happening. I see that the testset data isn't generating and just going into a continuous loop, exhausting the tokens of openAI **My Code** from...

Vtej98

Error code: 400 The response was filtered due to the prompt triggering Azure OpenAI's content management policy

6

**Describe the bug** Followed the tutorial for RAGAS with Azure OpenAI in this link https://docs.ragas.io/en/stable/howtos/customisations/azure-openai.html and encountered error "The response was filtered due to the prompt triggering Azure OpenAI's content...

AjitAntony

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** Can this part of the code be **applied to Chinese scenarios**?...

w666x

Evaluation task blocked

4

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** I use ragas to evaluate my RAG system. For now, I have...

anoukbarnoud-doctolib

[ x] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** Contradiction in evaluate is_async parameter. By default this parameter is True,...

dschwalm