About target encoder

[ZhaoYuTJPU]

First of all, thanks for your work. I have a question about the parameter update of the Target encoder. As shown in the figure, the function will be executed in each forward process, and then the parameters will be copied from the Online encoder instead of always using the EMA update. I don't understand it very well. I look forward to your reply.

[lc17721825]

I have the same confusion about the projector in online_encoder. The projector is created every time in the forward() of online_encoder. Have you figured it out?

[ZhaoYuTJPU]

Hello. I think I've solved the problem. The function _get_target_encoder has a decorator on it, which makes it run only once, not every time. You can see this process with single-step debugging. I hope this solves your problem.

[lc17721825]

Thanks for your reply. The projector follows the same situation and uses a decorator.