ema-pytorch
ema-pytorch copied to clipboard
lucidrains
A simple way to keep track of an Exponential Moving Average (EMA) version of your pytorch model
Hi there, first of all thanks for the really useful library! There is one thing I have run into which I think could be a good addition to the library:...
Hi, thanks for your project. The EMA model is updated on CPU by iterating over all the parameters of the online model, which makes the GPU utility is low. Does...
I am running into an error when I am trying to wrap a model in the EMA object. ``` Traceback (most recent call last): File "", line 1, in File...
How does ema_pytorch handle BatchNorm statistics? Are BatchNorm statistics also averaged over steps? Should they be averaged?
Metadata
Owner
Metadata
A simple way to keep track of an Exponential Moving Average (EMA) version of your pytorch model