Yoav Katz
Yoav Katz
So first at the minimum, we need to document it. We need to consider if we want to "normalize the score" to range [0,1] by setting score = (cossin_score +...
Is it ok to just document this behavior (to avoid non backward compatible changes)? Users can decide on the needed normalization (@algadhib).
I think that the simplest approach in your code is to take max(0,score) of the score. This can be done only for 'metrics.rag.context_relevance.sentence_bert_mini_lm' or even on all scores. (Assuming negative...
We decided to document the behavior, and not change it. This is to allow the most natural interpretation: Computes semantic similarity using Sentence-BERT embeddings. Range: [-1, 1] (higher is better)...