setfit icon indicating copy to clipboard operation
setfit copied to clipboard

setfit for ranking problems?

Open turian opened this issue 2 years ago • 0 comments

I'd like to finetune setfit for ranking. Where, for each instance, there are possible text anwers in a ranked order.

I'd then like to finetune to maintain the ranking. Would this be possible?

fast-soft-sort can be used for differentiable ranking.

The idea might be that I am not fine-tuning the sentence-transformer of the input (or I can, optionally), but the output similarity transformer would be fine-tuned to optimize the rank score.

turian avatar Jul 16 '23 21:07 turian