windHat

Can it support t5 or mt5 model training?

2

### Describe the feature If I want to train t5 or mt5 model with my dataset,whether it can be implemented using Colossal AI ?

Thank you very much for sharing the code. In fact, I read the code and I want to know how to get these input files. For example, how can I...

train QA dataset without context,how can I do it?

1

If I want to train QA model and the QA dataset withdout context,how can I process it?

If I had trainied the model sucessfully with PPO method,how can I use it to inference?

When can the pretrained model be adapted to llama2?