quepid icon indicating copy to clipboard operation
quepid copied to clipboard

Published 20 hours ago • verified publisher icon o19s

nDCG computation is incorrect.

Open david-fisher opened this issue 1 year ago • 0 comments

Describe the bug When computing nDCG, IDCG, the ideal DCG value, is to be computed on the full set of sorted relevance judgments, not the top K. Computing on top K inflates the nDCG value. To Reproduce Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior The score computes the correct value. Screenshots If applicable, add screenshots to help explain your problem.

Additional context Add any other context about the problem here.

david-fisher avatar Sep 20 '23 19:09 david-fisher