pygaggle icon indicating copy to clipboard operation
pygaggle copied to clipboard

Ranking on Query/Documents of custom dataset

Open ahadda5 opened this issue 2 years ago • 0 comments

I'd like to benchmark monoT5 against a custom dataset which has 25 possible labels/targets. The model generates a seq, I'm still not sure how you can transform that to logits representing specific targets/labels? Is there a notebook for custom datasets ? thanks

ahadda5 avatar Jan 18 '23 17:01 ahadda5