Nikita Mochalov
Results
2
issues of
Nikita Mochalov
Hi there! In the function corresponding to NDCG calculation I noticed that `ignore_rank_of_non_annotated_urls` flag is present. https://github.com/github/CodeSearchNet/blob/76a006fda591591f196fd0aef1d6282af3135f71/src/relevanceeval.py#L76 The question is: are your results in the paper calculated with `ignore_rank_of_non_annotated_urls=True`?
As stated in the title each package in the response has `"import_count": 0`. Example: `{'path': 'github.com/gorilla/mux', 'import_count': 0}`