RTX icon indicating copy to clipboard operation
RTX copied to clipboard
verified publisher icon RTXteam

Answer quality review

Open edeutsch opened this issue 2 years ago • 0 comments

While testing the results of Chunyu's fix for #1925 (which seem to be working nicely as designed) I decided to examine the current answer quality and ranking for our example query. Here's the latest: https://arax.ncats.io/devED/?r=130263

The top answer is Desmopressin. hmm. Expected high answer PTGS1 is eighth. Why is that?

Although the NGD for PTGS1is substantially better than Desmopressin, Desmopressin appears to win because it seems to have two identical edges pointing in opposite ways. While PTGS1 only has a single edge.

What do we think of this? I'm thinking two identical edges pointing in opposite directions should not count twice in ranking.

edeutsch avatar Mar 04 '23 07:03 edeutsch