Implement Contextual Retriaval

[marcofiocco]

Anthropic's Contextual Retriaval seem to improve results significantly. See here https://github.com/anthropics/anthropic-cookbook/blob/main/skills/contextual-embeddings/guide.ipynb

[ashishjaddu]

The latest LightRAG approach also seems promising. https://github.com/HKUDS/LightRAG

[adegboyegaFAU]

This has been implemented on llamaindex but having trouble using LlamaIndexTextSplitterAdapter because llamaindex implementation is designed to accept multiple documents whereas LlamaIndexTextSplitterAdapter accepts single documents.

[stellasia]

Thanks for the suggestion, we can not prioritize this work for now. If this is important to you, you can implement your own Retriever.