Vincent Roulet
Vincent Roulet
Hello @LidiiaS, Thanks for the issue and the reproduction code. Unfortunately, Jaxopt is archived.
Hello @Saanidhyavats, It makes sense indeed. Would you like to contribute to such a PR? Make sure to take a look at the other losses to see some template and...
The repository of the original author seems to have some weight decay https://github.com/juntang-zhuang/Adabelief-Optimizer/tree/update_0.2.0. So having a weight decay implementation makes sense. I agree with Robert that the current duplications of...
Hello @ro0mquy, I'd be happy to see how you handled it. I was not sure what would be the best solution to add this while keeping the API light. So...
Hello @ro0mquy, Any commit will retrigger the tests, so you may merge with main for example. By curiosity 1. why did you need the aux value returned ? (use cases...
@theo-brown A linesearch needs to evaluate the function at the candidate point to know whether it will be accepted or not. Ideally, if a point is accepted one would keep...
Done in #1220
Done in #1306
Check this https://optax.readthedocs.io/en/latest/api/optimizers.html#optax.lion first. Let me know tif you want to change the current implementation.
Thanks ! Sorry for the delay. Do you think it would be possible to add the smooth option to the current implementation? That way we minimize code duplication and maintenance...