Test/Valid Candidates

[wcx12]

If I want the candidate set for the test/verification to consist of 1 positive sample and 999 negative samples instead of using the entire item set as the candidate set, how should I do it?

[hyp1231]

This likely can’t be achieved just by tweaking some arguments.

Instead, you’ll need to implement it manually. You can refer to this example to see how to fetch the ground truth item in each batch of the test set, how to map external item IDs to internal IDs.

Then, you might be able to manually attach 999 negative samples to each positive one.