Sean MacAvaney

There's this in the meantime, which uses the current master version of this repository (thanks @andrewyates). https://pypi.org/project/pytrec-eval-git/ It doesn't include the open PRs, though.

@christopherfeld -- have you tried instaling [the `pytrec-eval-terrier` fork](https://github.com/cvangysel/pytrec_eval/issues/32#issuecomment-839708705) listed above? A GA build suggests that it works for Windows on Python 3.9. (The fork is imported as as pytrec_eval,...

Handling floating point relevance scores would require a larger change within `trec_eval` itself. https://github.com/usnistgov/trec_eval/blob/master/trec_format.h#L27

Hi @nimasadri11, Thanks for reporting this problem. It looks like it's installing from source. What platform are you using (OS, python version, etc.)? I'm able to reproduce the problem on...

It doesn't look like there's a CentOS bdist, but the following should work as a temporary workaround (based on the answer [here](https://stackoverflow.com/questions/67074684/pip-has-problems-with-metadata)): ``` pip install --upgrade --no-cache-dir --use-deprecated=legacy-resolver pytrec-eval-terrier==0.5.1 ```

@nimasadri11, sdist should be fixed with 0.5.2 -- can you try installing it on CentOS?

This should be fixed in here: https://github.com/seanmacavaney/pytrec_eval/blob/master/tests/pytrec_eval_tests.py#L224

Yes, adding units and writing better descriptions would be helpful. The `leave` and `ncols` settings are important for the usability of the tool on the command line. Removing ncols makes...

That sounds fair. So tqdm could be set with CLI defaults in CEDR, and then PyTerrier could overwrite that reference.

Ah, yes it seems so. The problem arose from re-using the `item` variable. Thanks! ``` In [1]: import torch # BEFORE In [2]: ...: def _mask(items, l): ...: result =...