raptor icon indicating copy to clipboard operation
raptor copied to clipboard

How to get the ONLY original documents' chunks?

Open daniyal214 opened this issue 5 months ago • 8 comments

While retrieval I did context, __ = RA.retrieve(question) to see the context, since I was not getting the desired response. I noticed that the context that is being passed to qa_model to answer question self.qa_model.answer_question(context, question) is not the actual chunk of text. There are also summarized text in the node list when we do self.context_chunks = [node.text for node in node_list]. I wonder how can I get the actual chunks nodes only, since I desire to pass only the actual context text to qa model.

My actual docs has lots of tutorial urls (which i need in response) in various places. But every time I get the response, the urls are messed up, broken or missing. So I dig up to check and found out that qa not getting only the actual chunks.

Is there any way to retrieve the context which should be the original portions of documents?

Thanks.

daniyal214 avatar Sep 02 '24 12:09 daniyal214