models icon indicating copy to clipboard operation
models copied to clipboard
verified publisher icon NVIDIA-Merlin

Add `seed` to `TopKMetric` for consistent metrics when ties in ranking

Open oliverholworthy opened this issue 3 years ago • 0 comments

Goals :soccer:

  • Improve reliability of tests using top-k metrics

Implementation Details :construction:

  • Adds seed parameter to TopKMetric classes to ensure results are consistent when evaluation run multiple times on the same data.
  • Fixes pre parameter when using model.predict (typo in variable referenced)

Testing Details :mag:

  • Adds a test for seed parameter with NDCGAt

oliverholworthy avatar Oct 26 '22 10:10 oliverholworthy