instinct.cpp icon indicating copy to clipboard operation
instinct.cpp copied to clipboard
verified publisher icon RobinQu

RAG Evaluation

Open RobinQu opened this issue 1 year ago • 1 comments

A notebook for experiment, including:

  • [x] comparision with langchain as baseline.
  • [ ] ablation test for different retrivers, spliter paramters.

RobinQu avatar Apr 03 '24 14:04 RobinQu

intial notebook is located at https://github.com/RobinQu/instinct.cpp/blob/sprint/v0.1.1/modules/instinct-examples/doc-agent/test/rag_evaluation/rag_evaluation.ipynb

RobinQu avatar Apr 03 '24 14:04 RobinQu

Inconsistency problem of RecursiveCharacterSplitter is resolved. Evaulation should be fair now.

RobinQu avatar Jun 16 '24 12:06 RobinQu

Close this issue. The evaulation script is stable since last version.

RobinQu avatar Jul 01 '24 08:07 RobinQu