zhuyiqun
Results
1
comments of
zhuyiqun
Have you solved this problem, especially when TP>1. > sorry for my unclarity, I used the train_gpt_demo script in the main branch of Colossalai repo `examples/language/gpt/gemini/train_gpt_demo.py`. I can't find the...