Simon Blanke

icon indicating an email [email protected]

icon company Hensoldt icon location Germany icon location Full-Stack-Developer. Open-source developer in my free time. Interested in optimization algorithms and machine learning. M.Sc. and B.Eng.

Results 74 comments of Simon Blanke

Can these methods be applied to llama model training?

Hello @mosheduminer, thank you for continuing this experiment. The result is in line with what I would expect for gradient-free-optimization algorithms. It would be useful to open a PR. Maybe...

Can these methods be applied to llama model training?

Thanks again to everyone how participated in this issue. I will close this issue for now. I will keep an eye on this topic and will probably start a new...

API changes for v2

since there are multiple kinds of "powell's methods", the existing "powell's method" in GFO will be renames to "Powell's Conjugate Direction Method" in v2.0

API changes for v2

The objective-function and the search-space are not optimizer specific parameters. It makes more sense to move the search-space argument to the `search`-method. So the v2 API could look like this:...