evaluation icon indicating copy to clipboard operation
evaluation copied to clipboard

Published 20 hours ago • verified publisher icon bigscience-workshop

Add BLiMP to Full Benchmark

Open epavlick opened this issue 3 years ago • 5 comments

epavlick avatar Aug 10 '21 14:08 epavlick

I would love to take this one on!

jumelet avatar Aug 10 '21 15:08 jumelet

@jumelet Do you have any updates?

sebastianGehrmann avatar Jan 17 '22 13:01 sebastianGehrmann

Thanks for the nudge, I haven't been too involved with Big Science lately. I've created a PR for the task here.

jumelet avatar Jan 24 '22 15:01 jumelet

Started working on prompts for adjunct_island subset, draft PR here - https://github.com/bigscience-workshop/promptsource/pull/736

Urmish avatar Apr 25 '22 19:04 Urmish

Update. Working with Najoung Kim on this. Planning to write 6-10 prompts for a single subset and then copy them to others.

Urmish avatar Apr 25 '22 19:04 Urmish