Yuxiang Liang

[NeuralChat] RAG evaluation

3

1. Data augmentation: retrieval dataset construction, include (1) Context to Question and Mine Hard Negatives, (2) Context, Question to Ground Truth. 2. Retrieval evaluation: MRR (Mean reciprocal rank) and Hit...

[Question]: Reproduce LongLLMLingua on the LongBench MultiDoc dataset

3

### Describe the issue We are interested in your longllmlingua results on longbench. We referred to these two parts of your code[https://github.com/microsoft/LLMLingua/blob/main/experiments/llmlingua2/evaluation/compress.py ][https://github.com/microsoft/LLMLingua/blob/main/experiments/llmlingua2/evaluation/eval_longbench.py], and other settings are as follows. target...