charliehullmoonpig
charliehullmoonpig
There's a similar feature in Solr https://solr.apache.org/guide/solr/latest/query-guide/common-query-parameters.html#field-name-aliases
We think this is expected, because the scorer takes into account other judged results that aren't being shown. On David's advice I created a scorer that calculates NDCG@n where n...
Further investigation has revealed it may be certain kinds of apostrophe (" or `) causing the problem. Replacing or removing these in the prompt makes it work.