instinct.cpp
instinct.cpp copied to clipboard
RAG Evaluation
A notebook for experiment, including:
- [x] comparision with langchain as baseline.
- [ ] ablation test for different retrivers, spliter paramters.
intial notebook is located at https://github.com/RobinQu/instinct.cpp/blob/sprint/v0.1.1/modules/instinct-examples/doc-agent/test/rag_evaluation/rag_evaluation.ipynb
Inconsistency problem of RecursiveCharacterSplitter is resolved. Evaulation should be fair now.
Close this issue. The evaulation script is stable since last version.