Megatron-LM icon indicating copy to clipboard operation
Megatron-LM copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

[QUESTION] how to profile bubble time in pipeline parallelism?

Open robotsp opened this issue 1 year ago • 4 comments

Your question how can we profile bubble time in pipeline parallelism accurately?

robotsp avatar Feb 07 '24 02:02 robotsp

Marking as stale. No activity in 60 days.

github-actions[bot] avatar Apr 07 '24 18:04 github-actions[bot]

same question

starstream avatar Apr 18 '24 08:04 starstream

Same question

HodBadichi avatar Jun 15 '24 01:06 HodBadichi

Marking as stale. No activity in 60 days.

github-actions[bot] avatar Aug 14 '24 18:08 github-actions[bot]