promptsource

promptsource copied to clipboard

Muennighoff

Add prompt templates to the CLUE benchmark tasks. Currently: - 3 original task prompt templates - 1 non-original task prompt template WIP: - NLI (ocnli, cmnli) - IFLYTEK: it has...

yongzx

This is a bit hacky, maybe you don't want it ```python from promptsource.templates import DatasetTemplates from functools import partial import multiprocessing import os import datasets from datasets import load_dataset from...

Muennighoff

xcopa ID prompt translation

2

waiting for https://github.com/bigscience-workshop/promptsource/pull/795

afaji

Muennighoff

Tidy tydiqa

2

@KhalidAlt Great work on the dataset & sorry for just opening a 2nd pr with it If someone has bandwidth would be great to add the arabic prompts via PR...

Muennighoff

Muennighoff

Add mbpp

2

Adds mbpp. I kept it simple as the function instructions are already very diverse. cc @haileyschoelkopf @thomasw21 @lintangsutawika Two examples: ``` ('Write a function to find the minimum cost path...

Muennighoff

Muennighoff

See: https://huggingface.co/datasets/Helsinki-NLP/tatoeba_mt/ I left the python script I used inside for others to use. I can rmv it if it's a problem :) cc @haileyschoelkopf @thomasw21 @lintangsutawika Tests are failing...

Muennighoff