dec icon indicating copy to clipboard operation
dec copied to clipboard

[Q] What does lambda (annealing speed) do?

Open rmurphy2718 opened this issue 2 years ago • 0 comments

Hello, great work!

In the paper and the code, you refer to an "annealing speed" lambda ranging over 10*(2^i) for i = 0, 1, ..., 8.

What does this refer to? Is it a learning rate annealer? Do you mean this is how often you reduce the learning rate?

I tried to read the code but could not figure out what seek does (the lambda parameter is used to update this data seek thing).

Thank you very much!

rmurphy2718 avatar Sep 16 '22 19:09 rmurphy2718