unitxt icon indicating copy to clipboard operation
unitxt copied to clipboard
verified publisher icon IBM

Make model based metrics rely on InferenceEngine

Open elronbandel opened this issue 1 year ago • 0 comments

InferenceEngine abstraction can make model based metrics model invariant and updated with ease

  • [ ] Detector
  • [ ] Safety
  • [ ] Regard

A great example is the CodeMix by @arielge : https://github.com/IBM/unitxt/blob/9a9d5de744937243b8d6d307d97cb686819478b4/src/unitxt/metrics.py#L4002

elronbandel avatar Jul 02 '24 19:07 elronbandel