Update about the coming soon FLUE tasks

[Tixierae]

Hi! Thank you for your open source initiative, and for creating FLUE. I was wondering if you could provide us with an update about when the code and data will be released for the following tasks, which are listed as 'coming soon' on the website:

5.1. Verb Sense Disambiguation 6. Named Entity Recognition 7. Question Answering

We are developing our own language model and would like to evaluate it across all FLUE tasks. Thank you!

[formiel]

Hi @Tixierae,

Thank you for your interest in the FLUE benchmark!

Regarding NER and QA, we unfortunately haven't been able to work that out yet. I hope I can find some time to work on this over the next months. To avoid confusion, I will remove them from the README, sorry about that!

Regarding Disambiguation, @loic-vial could you please help on this?

[VSegonne]

Hi, Regarding VSD, This will be available in the next few weeks. Best regards, VS

Le ven. 3 juil. 2020 à 01:49, formiel [email protected] a écrit :

Hi @Tixierae https://github.com/Tixierae,

Thank you for your interest in the FLUE benchmark!

Regarding NER and QA, we unfortunately haven't been able to work that out yet. I hope I can find some time to work on this over the next months. To avoid confusion, I will remove them from the README, sorry about that!

Regarding Disambiguation, @loic-vial https://github.com/loic-vial could you please help on this?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/getalp/Flaubert/issues/29#issuecomment-653263744, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEEH3YHW5VAPUSRJRCIILITRZUMJ7ANCNFSM4OMN2SKA .

[Tixierae]

Thank you both for the quick replies and the updates! We will stay tuned!