instruct-eval icon indicating copy to clipboard operation
instruct-eval copied to clipboard

Add config to save eval results

Open arthurtobler opened this issue 2 years ago • 0 comments

Thanks for this neat repo, very convenient to evaluate LLM!

As a feature request, I would like to suggest adding an option to save results of an evaluation for the implemented tasks to allow for easier analytics. My understanding is that the current main.py only print results. It could be useful to store scores per sub-task as well for tasks like MMLU or BBH

arthurtobler avatar Jun 20 '23 16:06 arthurtobler