raptor
raptor copied to clipboard
How to get the ONLY original documents' chunks?
While retrieval I did context, __ = RA.retrieve(question)
to see the context, since I was not getting the desired response.
I noticed that the context that is being passed to qa_model
to answer question self.qa_model.answer_question(context, question)
is not the actual chunk of text. There are also summarized text in the node list when we do self.context_chunks = [node.text for node in node_list]
.
I wonder how can I get the actual chunks nodes only, since I desire to pass only the actual context text to qa model.
My actual docs has lots of tutorial urls (which i need in response) in various places. But every time I get the response, the urls are messed up, broken or missing. So I dig up to check and found out that qa not getting only the actual chunks.
Is there any way to retrieve the context which should be the original portions of documents?
Thanks.