Felipe Maia Polo comments

Results 4 comments of


                                            Felipe Maia Polo

How to finetune UniEval?

Thank you for sharing your code. I will review it soon and let you know if I have more questions!

Dear authors, I realized that the function which generates non-consistent summaries is missing in ([pseudo_data_summ.py](https://github.com/maszhongming/UniEval/blob/main/pseudo_data_summ.py)). Is this code available anywhere else? Thank you!

Add `--examples` Argument for Fine-Grained Task Evaluation in `lm-evaluation-harness`. This feature is the first step towards efficient multi-prompt evaluation with PromptEval [1,2]

Hi @baberabb, Thanks a lot for your comments! Regarding your final suggestion of merging `limit` and `examples`, I would be good with that. Do you mean just to just change...

[REVIEW]: ATAS - Academic Text Analysis System

Hi @RichardLitt , Thank you for the reminder! The proposed tool has the potential to have an impact on the Brazilian social sciences research landscape. However, I would recommend that...