Verba icon indicating copy to clipboard operation
Verba copied to clipboard

Tell RAG what to do if no relevant sources were found.

Open Japhys opened this issue 4 months ago • 0 comments

I am not sure if this has been implemented already but I don't see I way to change this.

If the RAG does not find relevant answers in the external sources, the model seems to generate an answer based on its internal knowledge and training. For my knowledge base this will not work. It should always say: I am sorry didn't find....blabla

Here are some possible scenarios to consider:

Fallback Mechanism: The model may have a fallback mechanism where it generates an answer based on its internal knowledge if no relevant information is found in the external sources.

Partial Answers: The model can generate an answer that is partially based on the found information and partially on its internal knowledge.

Information about the Lack of Information: The model can inform the user that no relevant information has been found and provide a general answer or ask for more context or specific details.

Hybrid Answers: The model can generate a hybrid answer where it tries to answer the question with the available information and at the same time indicates that not all information may be available.

Japhys avatar Sep 26 '24 09:09 Japhys