Albert Webson

Thanks! I rebased your branch to the latest `eval-hackathon` branch. The prompts themselves look good. Just some housekeeping questions left: 1. Why are your “question prompts” not original task? Don't...

1. Marking them as original task would be great. Thanks! Few prompts are part of their original datasets, as most datasets predate prompt-based models. The original task flag indicates if...

Also, the targets of your *_bool prompts should be, e.g., "False" as a single target sequence. Right now it's saying this example has "F", "a", "l", "s", "e" as five...

Thanks for the PR! Your prompts do not indicate no gold target. Please use `|||` in your jinja template to separate the input from the target. Additionally, we will discuss...