lm-evaluation-harness icon indicating copy to clipboard operation
lm-evaluation-harness copied to clipboard

Published 20 hours ago • verified publisher icon EleutherAI

Print "higher_is_better" in results table

Open haileyschoelkopf opened this issue 1 year ago • 1 comments

We should add a column to the printed results table, that displays an arrow pointing up if the metric's "higher_is_better" value is True, arrow pointing down otherwise.

Currently higher_is_better is not really used in the code.

haileyschoelkopf avatar Dec 18 '23 13:12 haileyschoelkopf

This can be a part of #1158

lintangsutawika avatar Dec 18 '23 18:12 lintangsutawika

@haileyschoelkopf I believe this issue should be closed now.

zafstojano avatar Jun 03 '24 15:06 zafstojano