Example Script for Seq2Seq QA?

[YianZhang]

🚀 Feature request

Hi!

I am trying to use prefix tuning to train a seq2seq question answering model (e.g. T5) but there is currently no example script for it. I have tried adapting the original transformers example but couldn't train the model properly - the resultant model's performance is unreasonably low.

This has been annoying us for weeks but we couldn't make much progress. We are relying on adapter-transformers for our research project, so it will be super helpful if a seqseq qa example script is available!

Thanks!

[ghost]

🚀 Feature request

Hi!

I am trying to use prefix tuning to train a seq2seq question answering model (e.g. T5) but there is currently no example script for it. I have tried adapting the original transformers example but couldn't train the model properly - the resultant model's performance is unreasonably low.

This has been annoying us for weeks but we couldn't make much progress. We are relying on adapter-transformers for our research project, so it will be super helpful if a seqseq qa example script is available!

Thanks!

+1 have you solved yet?