evaluate icon indicating copy to clipboard operation
evaluate copied to clipboard

AttributeError: module 'evaluate.info' has no attribute 'Config'.

Open josecannete opened this issue 2 years ago • 3 comments

Hi, thank you so much for all your work. This is just to let you know about an issue that appeared.

I was loading a metric using:

metric = evaluate.load("roc_auc", "multilabel")

And the following error appeared:

class ROCAUCConfig(evaluate.info.Config): AttributeError: module 'evaluate.info' has no attribute 'Config'.

It seems related to the last commit of this repo: https://github.com/huggingface/evaluate/commit/e4a2724377909fe2aeb4357e3971e5a569673b39

Also, it seems to work properly with and older version of the metric:

metric = evaluate.load("roc_auc", "multilabel", revision="cf0c51eddd2a1a324961982c0ee174d896569d20")

josecannete avatar Sep 22 '22 13:09 josecannete

Thanks for reporting, we noticed the issue and the PR got reverted. It should work again now.

lvwerra avatar Sep 22 '22 13:09 lvwerra

It's because also the metrics on the Hub got updated and it seems something with the versioning between evaluate and the scripts on the hub did not work properly.

lvwerra avatar Sep 22 '22 13:09 lvwerra

(Sorry deleted my comment b/c I wasn't 100% sure when it was merged)

Context on above comment: not 100% sure why this trickled over when we were installing via pypi as well

muellerzr avatar Sep 22 '22 13:09 muellerzr