Pytorch-PCGrad icon indicating copy to clipboard operation
Pytorch-PCGrad copied to clipboard

support for amp?

Open HanGuangXin opened this issue 2 years ago • 2 comments

Hi, thanks for your work!

I'm wondering whether this repository supports amp? or how can I do it?

HanGuangXin avatar May 17 '22 08:05 HanGuangXin

I have forked and implemented the idea here: https://github.com/anzeyimana/Pytorch-PCGrad-GradVac-AMP-GradAccum

anzeyimana avatar Jun 19 '22 08:06 anzeyimana

Nice work! Really appreciate it!

---Original--- From: "Antoine @.> Date: Sun, Jun 19, 2022 16:37 PM To: @.>; Cc: "Han @.@.>; Subject: Re: [WeiChengTseng/Pytorch-PCGrad] support for amp? (Issue #15)

I have forked and implemented the idea here: https://github.com/anzeyimana/Pytorch-PCGrad-GradVac-AMP-GradAccum

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

HanGuangXin avatar Jun 19 '22 08:06 HanGuangXin