abetatos

In ragas 0.1.8 in _context_relevancy.py ```python async def _ascore(self, row: t.Dict, callbacks: Callbacks, is_async: bool) -> float: assert self.llm is not None, "LLM is not initialized" if self.show_deprecation_warning: logger.warning( "The...

In issue #963 I commented about the RuntimeError when trying to use TestsetGenerator. In issue #681 you discussed that using get_event_loop() was the optimal way to solve the issue but...

TestsetGenerator -> RuntimeError: ... got Future <..> attached to a differen t loop

3

This is related to: https://github.com/explodinggradients/ragas/issues/681 **Describe the bug** TestGeneration launches an error with default example of https://docs.ragas.io/en/stable/concepts/testset_generation.html with VertexAI models. Ragas version: 0.1.7 Python version: Python 3.10.13 **Code to Reproduce**...

Possible bug in evaluate function

3

**Describe the bug** I have been using the evaluate function in ragas to obtain different metrics of a RAG system, the evaluation consists on 51 questions with gorund truth. I...