Andrianos Michail

icon indicating a website link www.cl.uzh.ch/en/research-groups/texttechnologies/Team/Current-Members/amichail.html

icon company University of Zurich icon location NLP & AI Researcher PhD Candidate of Computational Linguistics @ University of Zurich         

Results 5 comments of Andrianos Michail

feat: Add MLQA dataset for CrossLingual Retrieval

> @isaac-chung @Andrian0s I fixed the code to build language pair in this format: `lang1-lang2` (see screenshot below), and renamed `_eval_monolingual()` in `AbsTaskRetrieval`.I think it's ready for merging 🙂 >...

add xsim++ task under retrieval category

Isn't this by definition a CrossLingual Task (EN-Other languages) and therefore, shouldn't this extend the CrosslingualTask instead of MultilingualTask? Then you would also need to change your language definitions

add xsim++ task under retrieval category

Added some comments in the previous PR #601 as I am implementing something similar now and I have been working on the same issues.

Adding MIRACL Retrieval

@imenelydiaker @thakur-nandan I am soon opening an issue about e5 performance reproduction, the issue is (atleast through the retrieval evaluator) that we don't append the correct prompt. I have verified...

Adding MIRACL Retrieval

> > @imenelydiaker @thakur-nandan I am soon opening an issue about e5 performance reproduction, the issue is (atleast through the retrieval evaluator) that we don't append the correct prompt. I...