Megatron-DeepSpeed
Megatron-DeepSpeed copied to clipboard

Published 20 hours ago •

bigscience-workshop

Reame
Issues

Are there any other layer norm functions, such as RMSNorm or DeepNorm

Open lvcc2018 opened this issue 1 year ago • 0 comments

Are there any other layer norm functions, such as RMSNorm or DeepNorm

Feb 13 '23 13:02 lvcc2018