Zhong-Yi Li

icon indicating an email [email protected]

icon company Department of Electrical Engineering, National Taiwan University icon location Taipei, Taiwan icon location Natural Language Processing, Computational Linguistics

Results 1 issues of Zhong-Yi Li

Ocd

6 comment

implement Optimal Completion Distillation. add a new config named libri_ocd_example.yaml which enables ocd training. Not well tested. Might have bugs inside. temperature annealing not yet implemented. currently equals to 1e-8...