Chenjie Luo

Bug in the float limit handling

5

Hi, LM eval team, In this line: https://github.com/EleutherAI/lm-evaluation-harness/blob/main/lm_eval/evaluator.py#L439 The limit is reassigned to an int if the original limit flag is a float. However, this does not count the case...

Fix float limit override

1

See: https://github.com/EleutherAI/lm-evaluation-harness/issues/2324 The float limit will be override with the previous int limit of multiple tasks are triggered together. This PR fix this issue