rexmex
rexmex copied to clipboard
A general purpose recommender metrics library for fair evaluation.
Hey AstraZeneca, The related line of code: https://github.com/AstraZeneca/rexmex/blob/44f453ff20e92569270b9e1cfcb75b44b7839128/setup.py#L3 Is it a strict requirement for `rexmex` to have `Pandas
# Summary Remove the fix for the pandas version as it causes issue with PyKEEN #51 - [] Code passes all tests - [N/A] Unit tests provided for these changes...
Hey rexmex team, I wanted to ask you if there is a specific reason why your installation requires pandas to be of this version? Since this package gets installed with...
Hi, is it possible binarize a metric set instead of a single metric?
# Summary This PR streamlines generating metric sets and annotates more functions. - [x] Code passes all tests - [x] Unit tests provided for these changes - [x] Documentation and...
# Summary This PR uses the `rexmex.utils.Annotator` to annotate information about ranking metrics (e.g., MR, MRR, Hits @ K). I'm not familiar with all of the rankings, so help would...
The current binarize function uses a cutoff of 0.5 for binarization: https://github.com/AstraZeneca/rexmex/blob/3e266529761281ae832e49736e48d3e46f3b4af4/rexmex/utils.py#L28-L34 This is an issue for PyKEEN, where the scores that come from a model could all be on...
@mberr's adjusted mean rank address some of the problems with the mean rank, including its size dependence. Reference: https://arxiv.org/abs/2002.06914
# Summary In this PR I am introducing diagram first documentaiton. You can see how it renders here: https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/rexmex/on_boarding.md The diagrams are designed so that people can quickly grasp the...