RecTools icon indicating copy to clipboard operation
RecTools copied to clipboard

TP-based metrics fail to compute correct values with duplicates in interactions

Open blondered opened this issue 7 months ago • 0 comments

What happened?

Precision (and other Calssification and Ranking metrics) is not correct when there are duplicates in test interactions. See screenshot

Expected behavior

I suppose that correct value should be 1/3 because 2/3 of reco lists are False Positives.

Relevant logs and/or screenshots

Снимок экрана 2024-07-17 в 14 36 39

Operating System

macOS Big Sur 11.6 (Apple M1)

Python Version

any

RecTools version

0.6.0

blondered avatar Jul 17 '24 11:07 blondered