Yoav Katz

Results 74 comments of Yoav Katz

So first at the minimum, we need to document it. We need to consider if we want to "normalize the score" to range [0,1] by setting score = (cossin_score +...

Is it ok to just document this behavior (to avoid non backward compatible changes)? Users can decide on the needed normalization (@algadhib).

I think that the simplest approach in your code is to take max(0,score) of the score. This can be done only for 'metrics.rag.context_relevance.sentence_bert_mini_lm' or even on all scores. (Assuming negative...

We decided to document the behavior, and not change it. This is to allow the most natural interpretation: Computes semantic similarity using Sentence-BERT embeddings. Range: [-1, 1] (higher is better)...