Jafar Isbarov
Jafar Isbarov
Sorry, I am having laptop issues, so I won't be able to try it this week. To be clear, I am supposed to create a new analyzer, since the existing...
@gaydmi Thank you for bringing this up! @hynky1999 I have a question. Our dataset can be split into subsets in three ways: (a) make each language a subset, (b) make...
Both options sound good to me. I have added the dataset to Hugging Face: https://huggingface.co/datasets/jafarisbarov/TUMLU-mini @gaydmi let me know if I can help in any other way.
A temporary fix: 1. Update `requirements.txt` yourself. 2. Run `pip install -e .` in the base folder. 3. Verify with `pip show deberta`
Came here to open this issue. It took me some time to figure out that I need to a pass a custom task file and not a folder: ``` lighteval...
@cservan Same here! I just wanted to confirm that it is actually a bug.