lm-evaluation-harness icon indicating copy to clipboard operation
lm-evaluation-harness copied to clipboard

A little typing issue

Open yuti01 opened this issue 1 year ago • 0 comments

Hi! I think I have spotted a typing issue in the simple_evaluate function (see the relevant code here). According to the docs, the different seed arguments can be set to None to indicate the seed should not be set. However the type hint for these arguments is currently int instead of Optional[int] (or int | None).

yuti01 avatar Sep 10 '24 19:09 yuti01