Evaluating: 100%|██████████| 50/50 [12:00<00:00, 14.40s/it] eeror encountered whil evaluating using ChatOllama

[plaban1981]

[ ] I have checked the documentation and related resources and couldn't resolve my bug.

Describe the bug A clear and concise description of what the bug is.

Ragas version:0.1.20 Python version:3.11.0

Code to Reproduce import nest_asyncio nest_asyncio.apply()

from langchain_community.chat_models import ChatOllama from ragas import evaluate from langchain_community.embeddings import OllamaEmbeddings

langchain_llm = ChatOllama(model="llama3.2") langchain_embeddings = OllamaEmbeddings(model="llama3.2") #####Test wheter chat model works langchain_llm.invoke("How are you ?")

result = evaluate( eval_dataset, metrics= [ answer_correctness,answer_similarity, answer_relevancy, context_recall,context_precision ], llm=langchain_llm,embeddings=langchain_embeddings)

#####Extract the details into a dataframe results_df = result.to_pandas() results_df Error trace

Evaluating: 0%| | 0/50 [00:00<?, ?it/s]Exception raised in Job[26]: TimeoutError() Exception raised in Job[16]: TimeoutError() Evaluating: 2%|▏ | 1/50 [03:00<2:27:00, 180.02s/it]Exception raised in Job[33]: TimeoutError() Exception raised in Job[9]: TimeoutError() Exception raised in Job[34]: TimeoutError() Exception raised in Job[25]: TimeoutError() Exception raised in Job[44]: TimeoutError() Exception raised in Job[10]: TimeoutError() Exception raised in Job[17]: TimeoutError() Exception raised in Job[4]: TimeoutError() Exception raised in Job[18]: TimeoutError() Exception raised in Job[43]: TimeoutError() Exception raised in Job[8]: TimeoutError() Exception raised in Job[35]: TimeoutError() Exception raised in Job[27]: TimeoutError() Exception raised in Job[42]: TimeoutError() Exception raised in Job[36]: TimeoutError() Evaluating: 34%|███▍ | 17/50 [06:00<10:04, 18.32s/it] Exception raised in Job[19]: TimeoutError() Exception raised in Job[46]: TimeoutError() Exception raised in Job[21]: TimeoutError() Exception raised in Job[11]: TimeoutError() Exception raised in Job[29]: TimeoutError() Exception raised in Job[12]: TimeoutError() Exception raised in Job[20]: TimeoutError() Exception raised in Job[37]: TimeoutError() Exception raised in Job[28]: TimeoutError() Exception raised in Job[2]: TimeoutError() Exception raised in Job[38]: TimeoutError() Exception raised in Job[47]: TimeoutError() Exception raised in Job[30]: TimeoutError() Exception raised in Job[0]: TimeoutError() Exception raised in Job[45]: TimeoutError() Exception raised in Job[1]: TimeoutError() Evaluating: 66%|██████▌ | 33/50 [09:00<04:02, 14.24s/it]Exception raised in Job[13]: TimeoutError() Exception raised in Job[39]: TimeoutError() Exception raised in Job[5]: TimeoutError() Exception raised in Job[22]: TimeoutError() Exception raised in Job[31]: TimeoutError() Exception raised in Job[6]: TimeoutError() Exception raised in Job[41]: TimeoutError() Exception raised in Job[14]: TimeoutError() Exception raised in Job[48]: TimeoutError() Exception raised in Job[40]: TimeoutError() Exception raised in Job[23]: TimeoutError() Exception raised in Job[49]: TimeoutError() Exception raised in Job[15]: TimeoutError() Exception raised in Job[32]: TimeoutError() Exception raised in Job[3]: TimeoutError() Exception raised in Job[24]: TimeoutError() Exception raised in Job[7]: TimeoutError() Evaluating: 100%|██████████| 50/50 [12:00<00:00, 14.40s/it] Expected behavior It should return the values for the corresponding Evaluation Metric

Additional context

question | contexts | answer | ground_truth | answer_correctness | answer_similarity | answer_relevancy | context_recall | context_precision -- | -- | -- | -- | -- | -- | -- | -- | -- What should I be concerned about when consider... | [['Source: Casualty-Automotive, Vehicles and A... | When considering an autonomous vehicle exposur... | The rapid development of autonomous vehicle te... | NaN | NaN | NaN | NaN | NaN