unitxt icon indicating copy to clipboard operation
unitxt copied to clipboard

Turn safety and regard metrics to pure unitxt

Open elronbandel opened this issue 1 year ago • 2 comments

Those metrics cannot be loaded trough huggingface load dataset until re implementated as unitxt metrics.

elronbandel avatar Jun 24 '24 20:06 elronbandel

Hi @elronbandel , I gladly accept, but need some education..

dafnapension avatar Jun 25 '24 15:06 dafnapension

Running prepare/cards/bold.py which uses: metrics=["metrics.regard"], am I expected to go through metrics.regard._compute(..) ? It seems that I do not. I am missing the point here, I suspect.

dafnapension avatar Jul 01 '24 18:07 dafnapension

Resolved by PR #1004

dafnapension avatar Sep 22 '24 15:09 dafnapension