Yian Zhang

Example Script for Seq2Seq QA?

1

# 🚀 Feature request Hi! I am trying to use prefix tuning to train a seq2seq question answering model (e.g. T5) but there is currently no example script for it....

What subset of The Pile is the model evaluated on?

4

Hi, I downloaded the OpenSubtitles data from `https://storage.googleapis.com/ai21-public-data/lm_evaluation/datasets/doc_probs/max_seq_len_1024-4096KB/open_subtitles.jsonl` but I am unsure which part of The Pile it belongs to. For example, I cannot find the instance below in either...

Add the parameter `min_epochs` to the online code config so that the program can run. Set the default `span_classifier_loss_fn` of edge probing tasks to be `softmax` in defaults.config so that...

Hi Yikang, If I want to reproduce your work, what parameters should I use? In the readme, you suggest use the default parameters in main.py. At the same time, you...