sls
sls copied to clipboard
infer_c in sgd_armijo: where does it come from?
First, thanks for the nice work. I am excited to try out this optimizer.
I noticed that in get_optimizer you have the following line
https://github.com/IssamLaradji/sls/blob/318e9b569bdda96a925685030634238f043e3964/src/optimizers/init.py#L27
Where does this heuristic come from? Is it valid just for the experiments you're considering?