ColossalAI
ColossalAI copied to clipboard
[FEATURE]: train seq2seq model
Describe the feature
Is it not possible yet to train seq2seq model using colossalai? Given scripts are for causalLM models
Bot detected the issue body's language is not English, translate it automatically. π―ππ»π§βπ€βπ§π«π§πΏβπ€βπ§π»π©πΎβπ€βπ¨πΏπ¬πΏ
Title: [FEATURE]: train seq2seq model
@Sahajtomar This is just an example, welcome to try other models and submit PRs. For example #3567 Thanks.