vae-pretraining-encoder icon indicating copy to clipboard operation
vae-pretraining-encoder copied to clipboard
verified publisher icon bohanli

Cyclic annealing training

Open mshnmshn opened this issue 5 years ago • 0 comments

Hello, and thank you for the repo and the paper you published. I'm struggling to find the cyclic annealing option in the training scripts. Namely, I'm referring to the paper Cyclical annealing schedule: A simple approach to mitigating KL vanishing by Xiaodong Liu et al. Does the code support this annealing schedule? Thank you.

mshnmshn avatar Sep 15 '20 13:09 mshnmshn