seminars-fivt
seminars-fivt copied to clipboard
Seminars on optimization methods
Optimization methods, Department of Innovation and High Technologies, Fall 2018
Seminars on optimization methods
Syllabus
List of basic questions
- Introduction. Convex sets and cones
- Matrix calculus
- Convex functions
- KKT optimality conditions
- Duality
- Midterm
- Introduction to numerical optimization and gradient descent
- Beyond gradient descent: heavy ball, conjugate gradient and fast gradient methods
- Stochastic first-order methods
- Newton and quasi-Newton methods
- Projected gradient method and Frank-Wolfe method
- Linear programming problem + examples of tableau simplex method
- Semidefinite programming
- Intro to interior point methods