Felipe Maia Polo

How to finetune UniEval?

4

Dear authors, Thank you for the great work. I wanted to finetune UniEval on other datasets, let's say XSum (instead of CNN/DailyMail). What do you think the best way is...

Add `--examples` Argument for Fine-Grained Task Evaluation in `lm-evaluation-harness`. This feature is the first step towards efficient multi-prompt evaluation with PromptEval [1,2]

9

This PR introduces a new `--examples` argument to the evaluation pipeline in `lm-evaluation-harness`, enabling users to evaluate specific examples across multiple tasks. This enhancement extends the functionality of the `--limit`...

Hello, Do you make model trajectories (and their interactions with the system available)? I couldn't find them. Thank you!