yuenhern (yh)

UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 3417: character maps to <undefined> when trying to decode docs

6

**Describe the bug** The library was unable to decode byte into character. **Affected dataset(s)** - `msmarco-passage/dev/small` **To Reproduce** Steps to reproduce the behavior: 1. Make sure `collectionandqueries.tar.gz` has already been...

File structure stated in msmarco_passage.py is not aligned with downloaded top1000.dev.tar.gz

1

**Describe the bug** In `msmarco_passage.py` line 199-204, the `dev/small` dataset was: ``` subsets['dev/small'] = Dataset( collection, TsvQueries(Cache(TarExtract(dlc['collectionandqueries'], 'queries.dev.small.tsv'), base_path/'dev/small/queries.tsv'), namespace='msmarco', lang='en'), TrecQrels(Cache(TarExtract(dlc['collectionandqueries'], 'qrels.dev.small.tsv'), base_path/'dev/small/qrels'), QRELS_DEFS), TrecScoredDocs(Cache(ExtractQidPid(TarExtract(dlc['dev/scoreddocs'], 'top1000.dev')), base_path/'dev/ms.run')), ) ```...

Move tests to run on GitHub Actions

1

Created `.github/workflows/unit_tests.yml` to run tests on GitHub Actions as mentioned in Issue #16 . Unfortunately the workflow did not complete as there are tests that failed. See below: ``` Run...