Readers: Jie Lu, Richard Combes, Alexandre Proutiere
Prerequisites: Basics in analysis, optimization theory, and probability
Credits: 8hp Grading: P/F (homework + take-home exam)
Thank you again for taking this course. We hope that you learnt techniques that you can use in your research! The solutions to the take-home exam are available [here]
For any other information, please send an email to alepro@kth.se
The course is based on the course offered at UC Berkeley by Prof. M. Johansson and Prof. L. El Ghaoui in 2012, and the course A. Proutiere gave in Hamilton institute and IIT Mumbai in 2012 and 2013. The course have four parts: In the first part, we explore recent advances in first-order methods for convex optimisation (which constitute the main building block for many of the more advanced algorithms developed later). The second part focuses on algorithms for distributed optimisation under computation and communication constraints. Our starting point here is mathematical decomposition techniques traditionally developed for exploiting structure in large-scale optimisation. The third part is devoted to distributed stochastic optimisation techniques, including stochastic approximation and simulation-based methods. In the last part, we present recent advances in the theory of distributed learning in repeated games.
Schedule
- Sept 10 / 10:15AM-12:15PM | Brinellv. 23 (B24) | Overview and basic concepts in optimisation. Slides [PDF]
- Sept 12 / 10:15AM-12:15PM | Osquldasv. 6 (Q22) | Convexity, gradient descent and sub-gradient method. Slides [PDF]
- Sept 17 / 10:15AM-12:15PM | Osquarsbacke 14 (E52) | Optimal first order methods. Slides [PDF]
- Sept 19 / 10:15AM-12:15PM | Lindstedtv. 3 (E34) | Duality, dual decomposition, and ADMM. Slides [PDF]
- Sept 24 / 10:15AM-12:15PM | Drottning Krist. 30 (L42) | Iterative methods, parallel computing, and gossiping algorithms. Slides [PDF]
- Sept 26 / 10:15AM-12:15PM | Drottning Krist. 30 (L43) | Project session 1. [Papers]
- Oct 1 / 10:15AM-12:15PM | Drottning Krist. 30KV (L22) | Stochastic optimisation - Stochastic approximation. [Lecture notes] [Slides]
- Oct 8 / 10:15AM-12:15PM | Drottning Krist. 30KV (L22) | Sampling-based optimisation. [Lecture notes] [Slides]
- Oct 15 / 10:15AM-12:15PM | Brinellv. 23 (B23) | Learning in games 1. [Slides]
- Oct 17 / 10:15AM-12:15PM | Brinellv. 23 (B24) | Learning in games 2. [Slides]
- Oct 22 / 10:15AM-12:15PM | Brinellv. 23 (B24) | Project session 2. [Problems] [Pb1-2.solutions]