InstructRAG icon indicating copy to clipboard operation
InstructRAG copied to clipboard

Request for Guidance on Citation Support and Evaluation in InstructRAG

Open JiaangL opened this issue 8 months ago • 0 comments

Hi, thanks for the great work on InstructRAG! While running it on the ASQA dataset, I noticed that the get_metrics function only returns str-em, and the model outputs don't include citations to specific documents.

I understand that improving citation quality may not be the primary focus of this work, but any information you could share would help us better understand and build upon your approach. Could you also share how to enable citation generation in InstructRAG and how to evaluate those citations using corresponding metrics (i.e., citation precision & recall in Table 3)?

Thanks again for your valuable contributions!

JiaangL avatar Apr 21 '25 09:04 JiaangL