Abhay Singh comments

Repositories
Issues
Comments

Results 2 comments of


                                            Abhay Singh

Teacher Gradients

Hi. Firstly, thank you for you wonderful implementation! I was wondering about the implementation you used for the dot product in the calculation of the teacher MPL loss. Please correct...

Teacher Gradients

Thanks for the note @monney ! :) Could you elaborate about the Taylor expansion to approximate the dot product? Or point me in the right direction to read more.