Megatron-LM icon indicating copy to clipboard operation
Megatron-LM copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

[QUESTION] how to profile bubble time in pipeline parallelism?

Open starstream opened this issue 9 months ago • 1 comments

Your question Ask a clear and concise question about Megatron-LM. How can I profile bubble time and p2p comm time in pipeline parallelism?

starstream avatar May 15 '24 03:05 starstream