terapipe icon indicating copy to clipboard operation
terapipe copied to clipboard

Published 20 hours ago • verified publisher icon zhuohan123

Is Terapipe implemented on 1F1B schedule?

Open robotsp opened this issue 10 months ago • 1 comments

@zhuohan123 Hi Zhuohan,

Thanks for your cool work on pipeline parallelism. May I ask is Terapipe implemented on 1F1B schedule? Does it integrate on Megatron-LM framework?

Thanks!

robotsp avatar Apr 17 '24 07:04 robotsp