lm-evaluation-harness
lm-evaluation-harness copied to clipboard
A little typing issue
Hi! I think I have spotted a typing issue in the simple_evaluate function (see the relevant code here).
According to the docs, the different seed arguments can be set to None to indicate the seed should not be set. However the type hint for these arguments is currently int instead of Optional[int] (or int | None).