self-rag icon indicating copy to clipboard operation
self-rag copied to clipboard

About baseline's parameter 'task'

Open AllenShow opened this issue 1 year ago • 1 comments

Hi! Thanks for your great work. I find the task parameter in all example codes(run_baseline_lm.py) is 'qa', but in self-RAG, the task could be different values, such as arc_c, fever, asqa, factscore. So if I'd like to run run_baseline_lm.py, should I set different values for the task parameter according to different tasks? Or just set the parameter to 'qa' is fine for all kinds of tasks?

Thanks.

AllenShow avatar Jan 30 '24 15:01 AllenShow