AUC for Multi-label Multi-class classification task

[rvj07ai]

I am looking forward to have AUC for multi-label multi-class classification task but the AllenNLP library currently does not support it

Has anyone tried it earlier ?

[joelgrus]

we have AUC for binary classification

https://github.com/allenai/allennlp/blob/master/allennlp/training/metrics/auc.py

but I don't know of anyone who's implemented it for multi-label / multi-class classification, sorry.

[rvj07ai]

Thanks @joelgrus - I have tried reusing the auc mentioned above to implement a custom multi-label / multi-class classification AUC . Working on it..

[mukhal]

@rvj07ai Are you still working on this feature? I'm thinking of starting on it.