P3 - Better retrieval caching reuse logic

[ronakice]

Currently I think we need the exact top-$k$ file cached, but if you say, have top-100 file cached you shouldn't redo retrieval for top-20 reranking, this is an unnecessary step.