Scott Hoang
Results
11
issues of
Scott Hoang
--- Fix PERPLEXITY task evaluation crash due to incorrect sampling method detection Issue Evaluating perplexity-based tasks (e.g., lighteval|wikitext:103:document_level|0) causes an IndexError crash: File "lighteval/logging/info_loggers.py", line 298, in aggregate hash_types: list[str]...