RecBole icon indicating copy to clipboard operation
RecBole copied to clipboard

Model Metric Question in Sequence Recommendation

Open Afar8612 opened this issue 1 year ago • 1 comments

Hello, when I used the Sequential Recommendation Model to evaluate, I found that when I used the @Hit index and the @Recall index in the library to evaluate, what is the reason why the results are exactly the same when the calculation methods of the two are completely different?

Afar8612 avatar Oct 15 '23 08:10 Afar8612

@Afar8612 Thanks for your attention to RecBole! For your issue, the hit rate means the ratio of items in the predicted rank list that falls in ground-true set, while the recall index refers to the ratio of items in the ground-true set that falls in the predicted rank list. Since the number of items in gournd-true set and predicted rank list are the same within the calculation of recall@k and hits@k, the final results would be the same.

Fotiligner avatar Oct 24 '23 13:10 Fotiligner