achibb

Adding False Friends Dataset to German MTEB

10

Hi all, dataset: https://huggingface.co/datasets/aari1995/false_friends_en_de [associated paper](https://drive.google.com/file/d/1jgq0nBnV-UiYNxbKNrrr2gxDEHm-DMKH/view?usp=share_link) this dataset can be used to test german and especially multilingual models for their understanding capabilities of "false-friends". false friends are words that sound...

Adding German to MTEB

12

Hi everybody, I think it would be great to add German to the Benchmark as well, in a broader manner. I would like to support, if someone would tell me...

monolingual evaluation gives more than target language in results

7

scripts/run_mteb_german.py I am running this script and observed, that the script, even though specifying "de", also creates the other languages (like en, es, mostly for the multilingual datasets i suppose)....

Problems with mteb_meta for german evaluation

6

Hi everyone, I am having troubles with generating the mteb_meta for German, with just running the script. I am currently trying to format results but it does not seem to...

Hi there I wanted to Train a Colbert however I was wondering whether I should use a sentence transformers model or only a pre trained one. Also, is it possible...