Difference between revisions of "Optimization"
From MIPAL
Line 8: | Line 8: | ||
* [https://wiseodd.github.io/techblog/2018/03/14/natural-gradient/ Nice Blog post on Natural Gradient and Fisher's Information Matrix] | * [https://wiseodd.github.io/techblog/2018/03/14/natural-gradient/ Nice Blog post on Natural Gradient and Fisher's Information Matrix] | ||
* [https://ruder.io/optimizing-gradient-descent/ Gradient descent and its variants] | * [https://ruder.io/optimizing-gradient-descent/ Gradient descent and its variants] | ||
+ | * [http://www.eng.tau.ac.il/~talraviv/Rothblum2018/Presentations/splenary-beck.pdf The gradient method: past and present (Amir Beck, Tel Aviv Univ.)] |
Revision as of 04:56, 31 March 2020
- Homepage of Lieven Vandenberghe - Lectures on optimization
- Animations for optimization algorithms
- Convex optimization by Boyd and Vandenberghe (Textbook and slides are downloadable)
- Levenberg-Marquardt algorithm - Wikipedia
- Iterative methods for optimization by Kelley (Textbook is downloadable)
- Course on numerical linear algebra by Xiangmin Jiao @ stonybrook
- Course on Convex Optimization - Ryan Tibshrani @ CMU
- Nice Blog post on Natural Gradient and Fisher's Information Matrix
- Gradient descent and its variants
- The gradient method: past and present (Amir Beck, Tel Aviv Univ.)