RL4LMs icon indicating copy to clipboard operation
RL4LMs copied to clipboard

Mix-Precision training

Open lovodkin93 opened this issue 1 year ago • 2 comments

Hey, Are there any plans to add support for mixed precision training? I did see in #12 a temporary solution was suggested, but it still throws multiple exceptions relating to mathematical operations between fp16 and fp32 values. Thanks! @rajcscw

lovodkin93 avatar Dec 31 '22 13:12 lovodkin93