ragas

ragas copied to clipboard

Are Multi-context questions generated by using related docs or related chunks of the same doc?

1

Are Multi-context questions generated by using related docs or related chunks of the same doc?

nikithamary

jjmachan

Error 'openai.APIConnectionError: Connection error.' occurs when running generator.generate_with_langchain_docs().

5

[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug. **Describe the bug** Error 'openai.APIConnectionError: Connection error.' occurs when running generator.generate_with_langchain_docs(). Ragas version: 0.1.20 Python...

francescofan

ValueError: The metric [context_recall] that that is used requires the following additional columns ['reference'] to be present in the dataset.

12

[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question. **Your Question** I am getting this error while executing ValueError: The metric [context_recall]...

mariamas-rakbank

Can not generate test set by Ollama

10

```python from ragas.llms.prompt import Prompt from ragas import evaluate from ragas.metrics import ( answer_relevancy, faithfulness, context_recall, context_precision, ) from datasets import Dataset import requests import os from langchain_community.chat_models import ChatOllama...

CAICCU

**Describe the Feature** I am currently on a tier 1 account with Anthropic, which means I have a daily cap of 1M tokens (total - in and out). When trying...

ahgraber

Models via ChatOllama raise ConnectError()

1

For this code section using `ChatMistralAI` and `MistralAIEmbeddings` ```python from langchain_ollama.chat_models import ChatOllama from langchain_ollama.embeddings import OllamaEmbeddings import ragas from ragas import evaluate from ragas.metrics import answer_relevancy from ragas.llms import...

Sohammhatre10

**Describe the Feature** In some cases I think it would be interesting to generate a testdataset variable from a json file or dictionary with the necessary keys (question, answer, context...)...

almariscal

AttributeError

8

i deifned this function to not use the LLM calls but it still give me this error: Exception has occurred: AttributeError 'list' object has no attribute 'get_sample_type' File "C:\Users\Amin\OneDrive -...

amin-kh96

why is answer_relevancy always 0？

5

environment： python 3.9.20 datasets 3.0.1 langchain 0.3.3 langchain-community 0.3.2 langchain-core 0.3.10 langchain-openai 0.2.2 langchain-text-splitters 0.3.0 ragas 0.0.22 code: from langchain_community.chat_models import ChatOpenAI from langchain.prompts.chat import ChatPromptTemplate, SystemMessagePromptTemplate, HumanMessagePromptTemplate, \ MessagesPlaceholder...

Z-oo883