Add new task named e3c_v3_re

[sfarzi]

I want to add new task based on E3C v3.0 in Italian, English, Polish, Slovak, Slovenian and Greek Languges.

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.

---

saeed farzi seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[baberabb]

Hi! Thanks for your contribution! Is this a different subset than in #2681?

[sfarzi]

Hi there, It is totally different. Our benchmark contains Italian, English, Polish, Slovak and Greek whereas the evalita contains Italian dataset. Even in the Italian language, we collected different data. should you have any question feel free to reach out to me.

Cheers Saeed

On Mon, 17 Mar 2025, 23:49 Baber Abbasi, @.***> wrote:

Hi! Thanks for your contribution! Is this a different subset than in #2681 https://github.com/EleutherAI/lm-evaluation-harness/pull/2681?

— Reply to this email directly, view it on GitHub https://github.com/EleutherAI/lm-evaluation-harness/pull/2806#issuecomment-2731210118, or unsubscribe https://github.com/notifications/unsubscribe-auth/A76DSNJYTIDCS4FZKUATSOT2U5NPPAVCNFSM6AAAAABZFREBWSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDOMZRGIYTAMJRHA . You are receiving this because you authored the thread.Message ID: @.***> [image: baberabb]baberabb left a comment (EleutherAI/lm-evaluation-harness#2806) https://github.com/EleutherAI/lm-evaluation-harness/pull/2806#issuecomment-2731210118

Hi! Thanks for your contribution! Is this a different subset than in #2681 https://github.com/EleutherAI/lm-evaluation-harness/pull/2681?

— Reply to this email directly, view it on GitHub https://github.com/EleutherAI/lm-evaluation-harness/pull/2806#issuecomment-2731210118, or unsubscribe https://github.com/notifications/unsubscribe-auth/A76DSNJYTIDCS4FZKUATSOT2U5NPPAVCNFSM6AAAAABZFREBWSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDOMZRGIYTAMJRHA . You are receiving this because you authored the thread.Message ID: @.***>