DeepRec icon indicating copy to clipboard operation
DeepRec copied to clipboard

About hit radio@50 in the evaluation of AttRec

Open blcunlp opened this issue 4 years ago • 1 comments

hi, In the evaluation process of AttRec, when calculating the recommendation item rank of each user, why use the negative items instead of all items? this code in: DeepRec/utils/evaluation/SeqRecMetrics.py--->def evaluate1(self) image

In my understanding, It should be to calculate the score of each user and all items, then rank them, and finally take the top 50 to calculate HT@50.

Calculate it the way the code says, it does not have any positive items in the prediction process.

blcunlp avatar May 27 '20 04:05 blcunlp

Usually, we only consider recommending those items that the user has never seen. If an item is liked by the user, we don't want to repeatedly recommend it to him.

cheungdaven avatar May 28 '20 18:05 cheungdaven