[QUESTION] Is there a plan to introduce torch.compile into Megatron?

Open wuyujiji opened this issue 2 years ago • 3 comments

Your question Is there a plan to introduce torch.compile into Megatron to speed up the training performance?

Oct 30 '23 02:10 wuyujiji

@deepakn94 I have the same question

Nov 03 '23 11:11 bisunny

Marking as stale. No activity in 60 days.

Jan 02 '24 18:01 github-actions[bot]

+1, according to this, torch.compile can speed up the megatron server inference speed

Apr 16 '24 06:04 Jack47

Marking as stale. No activity in 60 days.

Jun 15 '24 18:06 github-actions[bot]