AE8803: Optimization-Based Learning Control and Games, Fall 2024Cource DescriptionThis course will cover analysis and design techniques in learning-based optimal control systems and differential games. Topics will include optimization under constraints, multiplier methods, descent methods, quasi-Newton methods, calculus of variations, Pontryagin's maximum principle, matrix Riccati equations, nonlinear optimality and relation to Hamilton's principle in physics, suboptimal control, dynamic and approximate dynamic programming, duality of optimal control and optimal estimation, differential games, Hamilton-Jacobi equations, value and policy iteration, Q-learning, approximation methods with reinforcement learning to adapt to optimal control solutions without knowing the full system dynamics. Tentative Syllabus: Here InstructorProf. Kyriakos G. Vamvoudakis
Office HoursTuThu, 11:00am - 12:30pm, Montgomery Knight Building, Office 415-B Please email or phone me in advance to schedule for an appointment. If you have any questions about the course, please send me email. I will try to respond as quickly as possible. Additionally, I will share questions that are particularly good (and their answers) with the rest of the class by broadcasting my answer to the entire class. If you plan to come to office hours for questions about homework, please be prepared to show attempts at solving the problem that you prepared before coming. Lecture Time and PlaceTuTh, 2:00pm - 3:15pm, Klaus 1207 Course CreditUnits: 3 PrerequisitesCompetency in linear algebra, probability, and understanding of model (state space) control theory. TextbooksThere is no required text. The instructor will provide notes and research papers. WebsiteThe website for this course will be maintained on Canvas and here. |