trectools

trectools copied to clipboard

Great library, thanks for all the excellent work! I'm trying to fuse 5 CSV files generated by 5 ranking models, after reading the documentation(example 6) I still don't know how...

BingliangLi

Hi everyone! I thought it might be useful to have the license information displayed on github in addition to PyPi. I used the paper authors as holders of the copyright...

cakiki

It would be nice for downstream distros if releases would be tagged in git/github.

SuperSandro2000

recall support

3

Hi, Is recall at different depths supported by the tool?

Fatima-Haouari

Fixes the issue of malformed runs.

ammsa

Malformed lines

1

Hi @joaopalotti, It seems that for malformed lines, such as:  trec_eval throws: trec_eval.get_results: Malformed line 790 While trec_tools does not. I am not sure that this is a bad...

lironT74

Mean Average Precision and Pooled Evaluations

1

I came across an issue with the calculation of the mean average precision of pooled evaluations which results in mAP@k being lower than expected if k is lesser than the...

wolfgangkircheis

Recall at depth K missing

5

The **Evaluation Measures** part of the readme mentions that the project has an implementation of recall at depth K, but I couldn't find one.

nbabulkov

For an overview of the missing measures, one can run `trec_eval -h -m set`.

hscells

I think this should be a fairly straight forward addition, each topic in MSMARCO is just a topic id and query separated by tab. Example: ``` 1108939 what slows down...

hscells