Megatron-LM icon indicating copy to clipboard operation
Megatron-LM copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

[QUESTION] Does the functionality of P2P overlap working for 1F1B scheduler?

Open wuziyou199217 opened this issue 1 year ago • 3 comments

Your question I've noticed that the functionality of P2P overlap has been implemented for interleaved pipeline scheduler, is there any possibility to port it to 1F1B pipeline scheduler theoretically?

wuziyou199217 avatar Aug 16 '23 07:08 wuziyou199217

We don't currently have plans to support this unfortunately. What is your use case?

deepakn94 avatar Sep 26 '23 05:09 deepakn94

Marking as stale. No activity in 60 days.

github-actions[bot] avatar Nov 25 '23 18:11 github-actions[bot]

@wuziyou199217 Did you implement the overlap?

robotsp avatar Apr 08 '24 04:04 robotsp

Marking as stale. No activity in 60 days.

github-actions[bot] avatar Jun 07 '24 18:06 github-actions[bot]