evaluate
evaluate copied to clipboard
AttributeError: module 'evaluate.info' has no attribute 'Config'.
Hi, thank you so much for all your work. This is just to let you know about an issue that appeared.
I was loading a metric using:
metric = evaluate.load("roc_auc", "multilabel")
And the following error appeared:
class ROCAUCConfig(evaluate.info.Config): AttributeError: module 'evaluate.info' has no attribute 'Config'.
It seems related to the last commit of this repo: https://github.com/huggingface/evaluate/commit/e4a2724377909fe2aeb4357e3971e5a569673b39
Also, it seems to work properly with and older version of the metric:
metric = evaluate.load("roc_auc", "multilabel", revision="cf0c51eddd2a1a324961982c0ee174d896569d20")
Thanks for reporting, we noticed the issue and the PR got reverted. It should work again now.
It's because also the metrics on the Hub got updated and it seems something with the versioning between evaluate
and the scripts on the hub did not work properly.
(Sorry deleted my comment b/c I wasn't 100% sure when it was merged)
Context on above comment: not 100% sure why this trickled over when we were installing via pypi as well