cpolcino
cpolcino
@dosu can you give the path to _faithfulness_output_parser.aparse?
@dosu may you give the expected JSON file ? HERE AN EXAMPLE OF WHAT I AM USING data_samples_2 = { 'question': ["What are the dimensions of twist?"], 'answer': ["The limits...
import torch print(torch.cuda.is_available()) print(torch.cuda.device_count()) print(torch.cuda.get_device_name(0)) True 1 Quadro P4000 result = evaluate(amnesty_subset, metrics=[ context_precision, faithfulness, answer_relevancy, context_recall], llm=langchain_llm,embeddings=embeddings,raise_exceptions=False) Error displaying widget: model not found Exception raised in Job[4]: TimeoutError() Exception...
@dosu /home/user/.pyenv/versions/3.11.9/lib/python3.11/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`. warnings.warn( Evaluating: ...
@dosu This can happen if the statements variable is None or empty after parsing the generated statements. Explain me better this part. i have created data_samples_1 by copyng for answer...
@dosu This can happen if the statements variable is None or empty after parsing the generated statements. Explain me better this part. i have created data_samples_1 by copyng for answer...
@dosu give me the code for the troubleshooting
@dosu from langchain_community.vectorstores import FAISS from langchain_community.vectorstores import Chroma from langchain.text_splitter import CharacterTextSplitter from langchain_community.embeddings import OpenAIEmbeddings from langchain_community.embeddings import HuggingFaceBgeEmbeddings from langchain.chains import RetrievalQA import os import time from...
@dosu how do i solve this error? Exception raised in Job[7]: TimeoutError() Exception raised in Job[4]: TimeoutError() Exception raised in Job[3]: TimeoutError() Exception raised in Job[5]: TimeoutError() Exception raised in...