Kyriakos G. Vamvoudakis - Publications

Books

[1] F. L. Lewis, H. Modares, B. Kiumarsi, K. G. Vamvoudakis, A Course in Reinforcement Learning for Feedback Control, in preparation.

[2] K. G. Vamvoudakis, Y. Wan, F. L. Lewis, D. Cansever (Eds.), Handbook on Reinforcement Learning and Control, to appear, Springer, 2021.

[3] K. G. Vamvoudakis, N.-M. T. Kokolakis, Synchronous Reinforcement Learning-Based Control for Cognitive Autonomy, to appear, Foundations and Trends in Systems and Control, vol. 8, no. 1-2, pp. 1-175, 2020.

[4] K. G. Vamvoudakis, S. Jagannathan (Eds.), Control of Complex Systems: Theory and Applications, Elsevier, 2016.

[5] D. Vrabie, K. G. Vamvoudakis,  F. L. Lewis, Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles, Control Engineering Series, IET Press, 2012.

Read reviews of Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles written by Warren E. Dixon that appeared in IEEE Control Systems Magazine, vol. 34, no. 3, pp. 80-92, and Journal of Guidance, Control, and Dynamics, vol. 37, no. 3, pp. 1048-1049, 2014.

Patents

[1] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, Optimal Online Adaptive Controller,” U.S. Patent No. 9,134,707, July 2015.

Journals

[1] Z. Xu, G. P. Kontoudis, K. G. Vamvoudakis, “Online and Robust Intermittent Motion Planning in Dynamic and Changing Environments,” submitted, 2020.

[2] F. Fotiadis, K. G. Vamvoudakis, “Detection of Actuator Attacks for Continuous-Time Systems with Intermittent State Feedback,” submitted, 2020.

[3] N.-M. T. Kokolakis, K. G. Vamvoudakis, “Bounded Rational Dubins Vehicle Coordination for Target-Tracking,” submitted, 2020.

[4] W. Gao, Y. Wang, K. G. Vamvoudakis, “Output-Feedback Learning-based Control of Nonlinear Disturbed Systems,” submitted, 2020.

[5] F. Fotiadis, K. G. Vamvoudakis, “Infinitely and Boundedly Rational Game-Theoretic Receding Horizon Control against Stealthy Attacks,” submitted, 2020.

[6] L. Zhai, K. G. Vamvoudakis, “Data-Based and Secure Switched Cyber-Physical Systems,” submitted, 2020.

[7] K. G. Vamvoudakis, A. Kanellopoulos, P. P. Sahoo, “Intermittent Learning Through Operant Conditioning: A New Perspective for Cyber-Physical Systems,” submitted, 2019.

[8] Y. Yang, H. Modares, K. G. Vamvoudakis, D. Wunsch, “Functional Adaptive Dynamic Programming with Approximation Errors,” submitted, 2019.

[9] A. Kanellopoulos, K. G. Vamvoudakis, “Bounded Rationality in Byzantine Sensors under Attacks,” submitted, 2019.

[10] J. I. Poveda, M. Benosman, K. G. Vamvoudakis, “Data-Enabled Extremum Seeking: A Cooperative Concurrent Learning-Based Approach,” to appear in International Journal of Adaptive Control and Signal Processing, 2020.

[11] Y. Zhou, K. G. Vamvoudakis, W. M. Haddad, Z. P. Jiang, “A Secure Control Learning Framework for Cyber-Physical Systems under Sensor and Actuator Attacks,” to appear in IEEE Transactions on Cybernetics, 2020.

[12] L. Zhai, K. G. Vamvoudakis, “A Data-Based Private Learning Approach for Enhanced Security against Replay Attacks in Cyber-Physical Systems,” to appear in International Journal of Robust and Nonlinear Control (Special Issue on Optimal Control and Learning for Cyber-Physical Systems), 2020.

[13] A. Chakrabarty, D. K. Jha, G. T. Buzzard, Y. Wang, K. G. Vamvoudakis, “Safe Approximate Dynamic Programming via Kernelized Lipschitz Estimation,” to appear in IEEE Transactions on Neural Networks and Learning Systems, 2020.

[14] Y. Yang, K. G. Vamvoudakis, H. Modares, W. He, Y. Yin, D. Wunsch, “Safe Intermittent Reinforcement Learning with Static and Dynamic Event Generators,” to appear in IEEE Transactions on Neural Networks and Learning Systems, 2020.

[15] Y. Yang, K. G. Vamvoudakis, H. Modares, Y. X. Yin, D. Wunsch, “Hamiltonian-Driven Hybrid Adaptive Dynamic Programming,” to appear in IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2020.

[16] S. Luo, F. L. Lewis, Y. Song, K. G. Vamvoudakis, “Adaptive Backstepping Optimal Control of a Fractional-Order Chaotic Magnetic-Field Electromechanical Transducer,” Nonlinear Dynamics, vol. 100, no. 1, pp. 523-540, 2020.

[17] Y. Yang, H. Modares, K. G. Vamvoudakis, Y. Yin, D. Wunsch, “Dynamic Intermittent Feedback Design for H-infinity Containment Control on a Directed Graph,” IEEE Transactions on Cybernetics, vol. 50, no. 8, pp. 3752-3765, 2020.

[18] P. P. Sahoo, K. G. Vamvoudakis, “On-Off Adversarially Robust Q-Learning,” IEEE Control Systems Letters (Special Issue on Learning and Control), vol. 4, no. 3, pp. 749-754, 2020. (This paper is listed in the Top 50 most accessed articles, IEEE Control Systems Letters, May 2020)

[19] Y. Yang, K. G. Vamvoudakis, H. Modares, “Safe Reinforcement Learning for Dynamical Games,” International Journal of Robust and Nonlinear Control, vol. 30, no. 9, pp. 3706-3726, 2020. (This paper also appeared as the cover image for the issue)

[20] L. R. Garcia Carrillo, K. G. Vamvoudakis, “Deep-Learning Tracking for Autonomous Flying Systems under Adversarial Inputs,” IEEE Transactions on Aerospace and Electronic Systems, vol. 56, no. 2, pp. 1444-1459, 2020.

[21] A. Kanellopoulos, K. G. Vamvoudakis, “A Moving Target Defense Control Framework for Cyber-Physical Systems,” IEEE Transactions on Automatic Control, vol. 65, no. 3, pp. 1029-1043, 2020. (This paper is listed in the Top 50 most accessed articles, IEEE Transactions on Automatic Control, June 2020)

[22] G. P. Kontoudis, K. G. Vamvoudakis, “Kinodynamic Motion Planning with Q-Learning: An Online, Model-Free, and Safe Navigation Framework,” IEEE Transactions on Neural Networks and Learning Systems, vol. 30, no. 12, pp. 3803-3817, 2019.

[23] X. Jin, W. M. Haddad, Z. P. Jiang, A. Kanellopoulos, K. G. Vamvoudakis, “An Adaptive Learning and Control Architecture for Mitigating Sensor and Actuator Attacks in Connected Autonomous Vehicle Platoons,” International Journal of Adaptive Control and Signal Processing (Special Issue on Learning From Adaptive Control Under Relaxed Excitation Conditions), vol. 33, no. 12, pp. 1788-1802, 2019.

[24] F. Tatari, K. G. Vamvoudakis, M. Mazouchi, “Optimal Distributed Learning for Disturbance Rejection in Networked Nonlinear Games under Unknown Dynamics,” IET Control Theory and Applications (Special Issue on Distributed Optimization and Learning for Networked Systems), vol. 13, no. 17, pp. 2838-2848, 2019.

[25] T. Attia, K. G. Vamvoudakis, K. Kochersberger, J. Bird, T. Furukawa, “Dynamical Estimation and Optimal Control of Vehicle Active Suspensions,” Vehicle System Dynamics, vol. 57, no. 10, pp. 1467-1493, 2019.

[26] G. P. Kontoudis, M. Liarokapis, K. G. Vamvoudakis, T. Furukawa, “An Adaptive Actuation Mechanism for Anthropomorphic Robot Hands,” Frontiers in Robotics and AI: Soft Robotics, vol. 6, no. 47, pp. 1-16, 2019.

[27] K. G. Vamvoudakis, F. R. Pour Safaei, J. P. Hespanha, “Robust Event-Triggered Output Feedback Learning Algorithm for Voltage Source Inverters with Unknown Load and Parameter Variations,” International Journal of Robust and Nonlinear Control, vol. 29, no. 11, pp. 3502-3517, 2019.

[28] D. A. Copp, K. G. Vamvoudakis, J. P. Hespanha, “Distributed Output-Feedback Model Predictive Control,” Systems and Control Letters, vol. 127, pp. 52-59, 2019. (This paper is No. 3 in the Top 25 most popular articles in Systems and Control Letters, June 2019)

[29] Y. Yang, K. G. Vamvoudakis, H. Ferraz, H. Modares, “Dynamic Intermittent Q-learning-Based Model-Free Suboptimal Co-Design of L2-Stabilization,” International Journal of Robust and Nonlinear Control, vol. 29, no. 9, pp. 2673-2694, 2019.

[30] A. Kanellopoulos, K. G. Vamvoudakis, “Non-Equilibrium Dynamic Games and Cyber-Physical Security: A Cognitive Hierarchy Approach,” Systems and Control Letters, vol. 125, pp. 59-66, 2019. (This paper is No. 12 in the Top 25 most popular articles in Systems and Control Letters, June 2019)

[31] K. G. Vamvoudakis, F. L. Lewis, W. E. Dixon, “Open-Loop Stackelberg Learning Solution for Hierarchical Control Problems,” International Journal of Adaptive Control and Signal Processing (Special Issue on Learning-Based Adaptive Control: Theory and Applications), vol. 33, no. 2, pp. 285-299, 2019. (This paper is a Top 20 most read paper, International Journal of Adaptive Control and Signal Processing, June 2019)

[32] B. Kiumarsi, K. G. Vamvoudakis, H. Modares, F. L. Lewis, “Optimal and Autonomous Control Using Reinforcement Learning: A Survey,” IEEE Transactions on Neural Networks and Learning Systems (Special Issue on Deep Reinforcement Learning and Adaptive Dynamic Programming), vol. 29, no. 6, pp. 2042-2062, 2018. (This paper is listed as a Publication Spotlight paper of the IEEE Computational Intelligence Society. This paper is No. 2 in the Top 50 most accessed articles, IEEE Transactions on Neural Networks and Learning Systems, August 2018)

[33] K. G. Vamvoudakis, J. P. Hespanha, “Cooperative Q-learning for Rejection of Persistent Adversarial Inputs in Unknown Networked Systems,” IEEE Transactions on Automatic Control, vol. 63, no. 4, pp. 1018-1031, 2018. (This paper is listed in the Top 50 most accessed articles, IEEE Transactions on Automatic Control, April 2018)

[34] K. G. Vamvoudakis, J. P. Hespanha, “Game-Theory-Based Consensus Learning of Double-Integrator Agents in the Presence of Worst-Case Adversaries,” Journal of Optimization Theory and Applications, vol. 177, no. 1, pp. 222-253, 2018.

[35] K. G. Vamvoudakis, H. Ferraz, “Model-Free Event-Triggered Control Algorithm for Continuous-Time Linear Systems with Optimal Performance,” Automatica, vol. 87, pp. 412-420, 2018. (This paper is No. 21 in the Top 25 most accessed articles, Automatica, June 2018)

[36] K. G. Vamvoudakis, “Q-learning for Continuous-Time Graphical Games on Large Networks with Completely Unknown System Dynamics,” International Journal of Robust and Nonlinear Control, vol. 27, no. 16, pp. 2900-2920, 2017.

[37] K. G. Vamvoudakis, J. P. Hespanha, “Online Optimal Operation of Parallel Voltage Source Inverters using Partial Information,” IEEE Transactions on Industrial Electronics (Special Issue on Data Driven Control and Learning Systems), vol. 64, no. 5, pp. 4296-4305, 2017.

[38] K. G. Vamvoudakis, H. Modares, B. Kiumarsi, F. L. Lewis, “Game Theory-Based Control System Algorithms with Real-Time Reinforcement Learning,” IEEE Control Systems Magazine (Special Issue on Game-Theoretical Methods in Control Systems), vol. 37, no. 1, pp. 33-52, 2017. (This paper is No. 1 in the Top 50 most accessed articles, IEEE Control Systems, February 2017)

[39] K. G. Vamvoudakis, “Q-learning for Continuous-Time Linear Systems: A Model Free Infinite Horizon Optimal Control Approach,” Systems and Control Letters, vol. 100, pp. 14-20, 2017. (This paper is No. 1 in the Top 25 most popular articles in Systems and Control Letters, May 2017)

[40] K. G. Vamvoudakis, A. Mojoodi, H. Ferraz, “Event-Triggered Optimal Tracking Control of Nonlinear Systems,” International Journal of Robust and Nonlinear Control, vol. 27, no. 5, pp. 598-619, 2017.

[41] F. Tatari, M. B. Naghibi-Sistani, K. G. Vamvoudakis, “Distributed Learning Algorithm for Nonlinear Differential Graphical Games,” Transactions of the Institute of Measurement and Control, vol. 39, no. 2, pp. 173-182, 2017.

[42] K. G. Vamvoudakis, M. F. Miranda, J. P. Hespanha, “Asymptotically-Stable Optimal Adaptive Control Algorithm with Saturating Actuators and Relaxed Persistence of Excitation,” IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 11, pp. 2386-2398, 2016. (This paper is in the Top 50 most popular articles in IEEE Transactions on Neural Networks, October 2016)

[43] L. R. Garcia Carrillo, K. G. Vamvoudakis, J. P. Hespanha, “Approximate Optimal Adaptive Control for Weakly Coupled Nonlinear Systems: A Neuro-Inspired Approach,” International Journal of Adaptive Control and Signal Processing (Special Issue on From Adaptive Control to Variable Structure Systems: Seeking for Harmony), vol. 30, no. 8-10, pp. 1494-1522, 2016.

[44] Q. Jiao, H. Modares, S. Xu, F. L. Lewis, K. G. Vamvoudakis, “Multi-Agent Zero-Sum Differential Graphical Games for Disturbance Rejection in Cooperative Control,” Automatica, vol. 62, pp. 24-34, 2016. (This paper was included in the most downloaded articles from Automatica in 2016)

[45] K. G. Vamvoudakis, “Non-Zero Sum Nash Q-learning for Unknown Deterministic Continuous-Time Linear Systems,” Automatica, vol. 61, pp. 274-281, 2015.

[46] K. G. Vamvoudakis, “Event-Triggered Optimal Adaptive Control Algorithm for Continuous-Time Nonlinear Systems,” IEEE/CAA Journal of Automatica Sinica (Special Issue on Extensions of Reinforcement Learning and Adaptive Control), vol. 1, no. 3, pp. 282-293, 2014. (This paper was No. 8 in the Top 50 most popular articles in IEEE/CAA Journal of Automatica Sinica, February 2015)

[47] M. I. Abouheaf, F. L. Lewis, K. G. Vamvoudakis, S. Haesaert, R. Babuska, Multi-Agent Discrete-Time Graphical Games and Reinforcement Learning Solutions,” Automatica, vol. 50, no. 12, pp. 3038-3053, 2014.

[48] K. G. Vamvoudakis, J. P. Hespanha, B. Sinopoli, Y. Mo, “Detection in Adversarial Environments,” IEEE Transactions on Automatic Control (Special Issue on Control of Cyber-Physical Systems), vol. 59, no. 12, pp. 3209-3223, 2014. (This paper was No. 12 in the Top 50 most popular articles in IEEE Transactions on Automatic Control, December 2014)

[49] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Online Learning Algorithm for Optimal Control with Integral Reinforcement Learning,” International Journal of Robust and Nonlinear Control, vol. 24, no. 17, pp. 2686-2710, 2014.

[50] S. Bhasin, R. Kamalapurkar, M. Johnson, K. G. Vamvoudakis, F. L. Lewis, W. E. Dixon, “A Novel Actor-Critic-Identifier Architecture for Approximate Optimal Control of Uncertain Nonlinear Systems,” Automatica, vol. 49, no. 1, pp. 82-92, 2013. (This paper is listed in the most cited Automatica articles published since 2013)

[51] F. L. Lewis, D. Vrabie, K. G. Vamvoudakis, “Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers,” IEEE Control Systems Magazine, vol. 32, no. 6, pp. 76-105, 2012. (This paper is consistently listed in the Top 50 most accessed articles, IEEE Control Systems, 2013-present)

[52] K. G. Vamvoudakis, F. L. Lewis, G. R. Hudas, “Multi-Agent Differential Graphical Games: Online Adaptive Learning Solution for Synchronization with Optimality,” Automatica, vol. 48, no. 8, pp. 1598-1611, 2012. (This paper was No. 5 in the Top 25 Hottest Articles in Automatica, Elsevier, September 2012)

[53] K. G. Vamvoudakis, F. L. Lewis, “Online Neural Network Solution of Nonlinear Two-Player Zero-Sum Games Using Synchronous Policy Iteration,” International Journal of Robust and Nonlinear Control, vol. 22, no. 13, pp. 1460-1483, 2012.

[54] K. G. Vamvoudakis, M. A. Christodoulou, “Adaptive Control of Mixed-Interlaced forms,” Chaotic Modeling and Simulation Journal: International Journal of Nonlinear Science, July 2012 Issue, pp. 526-542, 2012.

[55] K. G. Vamvoudakis, M. A. Christodoulou, “Adaptive Backstepping Neural Network Control for Mechanical Pumps,” Chaotic Modeling and Simulation Journal: International Journal of Nonlinear Science, January 2012 Issue, pp. 109-122, 2012.

[56] G. Hudas, K. G. Vamvoudakis, D. Mikulski, F. L. Lewis, “Online Adaptive Learning for Team Strategies in Multi-Agent Systems,” The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology (Special Issue on Intelligent Behaviors in Tactical Unmanned Systems), vol. 9, no. 1, pp. 59-69, 2012. (This paper was the Most-Read Article, SAGE Journals, 2012-2014)

[57] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Online Learning Algorithm for Zero-Sum Games with Integral Reinforcement Learning,” Journal of Artificial Intelligence and Soft Computing Research, vol. 1, no. 4, pp. 315-332, 2011.

[58] K. G. Vamvoudakis, F. L. Lewis, “Multi-Player Non Zero-Sum Games: Online Adaptive Learning Solution of Coupled Hamilton-Jacobi Equations,” Automatica, vol. 47, no. 8, pp. 1556-1569, 2011. (This paper was No. 17 in the Top 25 Hottest Articles in Automatica, Elsevier, September 2011)

[59] F. L. Lewis, K. G. Vamvoudakis, Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 41, no. 1, pp. 14-25, 2011. (This paper is the Top Article in Computational Intelligence, BioMedLib, February 2011-2017)

[60] K. G. Vamvoudakis, F. L. Lewis, Online Actor-Critic Algorithm to Solve the Continuous-Time Infinite Horizon Optimal Control Problem,” Automatica, vol. 46, no. 5, pp. 878-888, 2010. (This paper is selected to be included in the Virtual Special Issue of Annual Reviews in Control, as one of the papers with the highest citation rates in the control field. This paper is in the list of the most cited Automatica articles published after 2009 according to Scopus. This paper was No. 23 in the Top 25 Articles in Automatica, Elsevier, September 2010)

Chapters and Contributions in Books

[1] G. P. Kontoudis, K. G. Vamvoudakis, Z. Xu, RRT-QX: Real-Time Kinodynamic Motion Planning in Dynamic Environments with Continuous-Time Reinforcement Learning,” to appear in Brain and Cognitive Intelligence-Control in Robotics, ed. B. Wei, CRC Press, 2021.

[2] N.-M. T. Kokolakis, A. Kanellopoulos, K. G. Vamvoudakis, Bounded Rationality in Differential Games: A Reinforcement Learning-based Approach,” to appear in Handbook on Reinforcement Learning and Control, eds. K. G. Vamvoudakis, Y. Wan, F. L. Lewis, D. Cansever, Springer-Verlag, Berlin, 2021.

[3] A. Kanellopoulos, K. G. Vamvoudakis, V. Gupta, P. Antsaklis, Dissipativity-based Verification for Autonomous Systems in Adversarial Environments,” to appear in Handbook on Reinforcement Learning and Control, eds. K. G. Vamvoudakis, Y. Wan, F. L. Lewis, D. Cansever, Springer-Verlag, Berlin, 2021.

[4] F. L. Lewis, K. G. Vamvoudakis, Neuro-Inspired Control,” in Encyclopedia of Systems and Control, eds. Tariq Samad, John Baillieul, Springer-Verlag, Berlin, 2020.

[5] K. G. Vamvoudakis, Model-Free Reinforcement Learning-Based Control for Continuous-Time Systems,” in Encyclopedia of Systems and Control, eds. Tariq Samad, John Baillieul, Springer-Verlag, Berlin, 2020.

[6] A. Kanellopoulos, K. G. Vamvoudakis, Entropy-Based Proactive and Reactive Cyber-Physical Security,” in Foundations and Challenges in Proactive Network Defense, eds. Z. Lu, C. Wang, Chapter 3, Springer, 2019.

[7] H. Modares, B. Kiumarsi, K. G. Vamvoudakis, F. L. Lewis, Adaptive H-infinity Tracking Control of Nonlinear Systems Using Reinforcement Learning,” in Adaptive Learning Methods for Nonlinear System Modeling, eds. D. Comminiello, J. Principe, Chapter 14, Elsevier, 2018.

[8] K. G. Vamvoudakis, Model-Free Learning of Nash Games with Applications to Network Security,” in Control of Complex Systems: Theory and Applications, eds. K. G. Vamvoudakis, S. Jagannathan, Chapter 10, Elsevier, 2016.

[9] K. G. Vamvoudakis, S. Jagannathan, Introduction to Complex Systems and Feedback Control,” in Control of Complex Systems: Theory and Applications, eds. K. G. Vamvoudakis, S. Jagannathan, Chapter 1, Elsevier, 2016.

[10] K. G. Vamvoudakis, F. L. Lewis, D. Vrabie, Reinforcement Learning with Applications in Automation Decision and Feedback Control,” in Handbook on Computational Intelligence, ed. P. Angelov, Chapter 12, World Scientific, 2016.

[11] K. G. Vamvoudakis, G. R. Hudas, Past, Present and Future of Control Theory Applied to Autonomous Vehicles/Agents in Severe Conditions,” in Advanced Autonomous Vehicle Design for Severe Environments, eds. V. Vantsevich, M. Blundell, Chapter 1, NATO ASI Series, IOS Press, Amsterdam, 2015.

[12] K. G. Vamvoudakis, G. R. Hudas, Terrorist Threats, Agile Vehicle Trajectory Deviation and Critical Reposition in Interaction with Environment,” in Advanced Autonomous Vehicle Design for Severe Environments, eds. V. Vantsevich, M. Blundell, Chapter 2, NATO ASI Series, IOS Press, Amsterdam, 2015.

[13] K. G. Vamvoudakis, G. R. Hudas, New Methods and Techniques in Online Control and Learning,” in Advanced Autonomous Vehicle Design for Severe Environments, eds. V. Vantsevich, M. Blundell, Chapter 7, NATO ASI Series, IOS Press, Amsterdam, 2015.

[14] F. L. Lewis, K. G. Vamvoudakis, Neural Control and Approximate Dynamic Programming,” in Encyclopedia of Systems and Control, eds. Tariq Samad, John Baillieul, Springer-Verlag, Berlin, 2015.

[15] K. G. Vamvoudakis,  F. L. Lewis, Shuzhi Sam Ge, Neural Networks in Feedback Control Systems,” in Mechanical Engineers’ Handbook, Volume 2, Design, Instrumentation, and Controls, 4th Edition, ed. Myer Kutz, Chapter 23, John Willey, NY, 2015.

[16] K. G. Vamvoudakis, J. P. Hespanha, R. A. Kemmerer, G. Vigna, “Formulating Cyber-Security as Convex Optimization Problems,” in Control of Cyber-Physical Systems, Lecture Notes in Control and Information Sciences, ed. Danielle Tarraf, Volume 449, pp. 85-100, Springer-Verlag, Berlin, 2013.

[17] K. G. Vamvoudakis,  F. L. Lewis, Online Learning Algorithms for Optimal Control and Dynamic Games,” in Reinforcement Learning and Approximate Dynamic Programming for Feedback Control, eds. F. L. Lewis, D. Liu, Chapter 16, IEEE Press Computational Intelligence Series, 2013.

[18] S. Bhasin, R. Kamalapurkar, M. Johnson, K. G. Vamvoudakis,  F. L. Lewis, W. Dixon,An Actor-Critic-Identifier Architecture for Adaptive Approximate Optimal Control,” in Reinforcement Learning and Approximate Dynamic Programming for Feedback Control, eds. F. L. Lewis, D. Liu, Chapter 12, IEEE Press Computational Intelligence Series, 2013.

[19] K. G. Vamvoudakis,  F. L. Lewis, Online Adaptive Learning Solution of Multi-Agent Differential Graphical Games,” in Frontiers in Advanced Control Systems, ed. Ginalber Luiz Serra, Chapter 2, INTECH, 2012. (This book chapter has been accessed more than 3000 times, INTECH, 2016)

[20] K. G. Vamvoudakis,  F. L. Lewis, Online Gaming: Real Time Solution of Nonlinear Two-Player Zero-Sum Games Using Synchronous Policy Iteration,” in Advances in Reinforcement Learning, ed. Abdelhamid Mellouk, Chapter 18, INTECH, 2011. (This book chapter has been accessed more than 3000 times, INTECH, 2014)

[21] K. G. Vamvoudakis,  F. L. Lewis, Online Synchronous Policy Iteration Method for Optimal Control,” in Recent Advances in Intelligent Control Systems, ed. Wen Yu, Chapter 14, Springer-Verlag, Berlin, 2009.

Conferences

[1] M. Grammatopoulou, A. Kanellopoulos, K. G. Vamvoudakis, N. Lau, “A Multi-step and Resilient Predictive Q-learning Algorithm for IoT with Human Operators in the Loop: A Case Study in Water Supply Networks,” submitted, 2020.

[2] F. Fotiadis, K. G. Vamvoudakis, “Recursive Reasoning for Bounded Rationality in Multi-Agent Non-Equilibrium Play Learning Systems,” submitted, 2020.

[3] A. Kanellopoulos, F. Fotiadis, C. Sun, Z. Xu, K. G. Vamvoudakis, U. Topcu, W. E. Dixon, “Temporal Logic-based Intermittent, Optimal, and Safe Continuous-Time Learning for Trajectory Tracking,” submitted, 2020.

[4] S. Kampezidou, J. Romberg, K. G. Vamvoudakis, D. Mavris, “Online Adaptive Learning in Energy Trading Stackelberg Games with Time-Coupling Constraints,” submitted, 2020.

[5] S. T. Krauss, D. J. Stilwell, M. L. Psiaki, K. G. Vamvoudakis, “Detection of a Drifting Acoustic Beacon from a Navigating AUV,” to appear in IEEE/MTS OCEANS, Singapore-U.S. Gulf Coast, 2020.

[6] A. Kanellopoulos, F. Fotiadis, K. G. Vamvoudakis, V. Gupta, “A Meta-Learning and Bounded Rationality Framework for Repeated Games in Adversarial Environments,” to appear in IEEE Conference on Decision and Control, Jeju Island, Republic of Korea, 2020.

[7] Y. Yang, H. Modares, K. G. Vamvoudakis, C.-Z. Xu, “Optimal Recursive Backstepping for Nonlinear Systems in a Strict-Feedback Form with Continuous and Intermittent Updates,” to appear in IEEE Conference on Decision and Control, Jeju Island, Republic of Korea, 2020. (invited paper)

[8] S. Shivam, Y. Wardi, M. Egerstedt, A. Kanellopoulos, K. G. Vamvoudakis, “Intersection-Traffic Control of Autonomous Vehicles using Newton-Raphson Flows and Barrier Functions,” Proc. IFAC World Congress, Berlin, Germany, 2020.

[9] F. Fotiadis, A. Kanellopoulos, K. G. Vamvoudakis, “Constrained Differential Games for Secure Decision-Making against Stealthy Attacks,” Proc. American Control Conference, pp. 4658-4663, Denver, CO, 2020.

[10] N.-M. T. Kokolakis, A. Kanellopoulos, K. G. Vamvoudakis, “Bounded Rational Unmanned Aerial Vehicle Coordination for Adversarial Target Tracking,” Proc. American Control Conference, pp. 2508-2513, Denver, CO, 2020.

[11] G. P. Kontoudis, Z. Xu, K. G. Vamvoudakis, “Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning,” Proc. American Control Conference, pp. 3873-3878, Denver, CO, 2020.

[12] C. Sun, K. G. Vamvoudakis, “Continuous-Time Safe Learning with Temporal Logic Constraints in Adversarial Environments,” Proc. American Control Conference, pp. 4786-4791, Denver, CO, 2020.

[13] G. P. Kontoudis, M. Liarokapis, K. G. Vamvoudakis, “An Adaptive, Humanlike Robot Hand with Selective Interdigitation: Towards Robust Grasping and Dexterous, In-Hand Manipulation,” Proc. IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 251-258, Toronto, Canada, 2019.

[14] A. Kanellopoulos, K. G. Vamvoudakis, V. Gupta, “Decentralized Verification for Dissipativity of Cascade Interconnected Systems,” Proc. IEEE Conference on Decision and Control, pp. 3629-3634, Nice, France, 2019. (invited paper)

[15] S. Shivam, A. Kanellopoulos, K. G. Vamvoudakis, Y. Wardi, “A Predictive Deep Learning Approach to Output Regulation: The Case of Collaborative Pursuit Evasion,” Proc. IEEE Conference on Decision and Control, pp. 853-859, Nice, France, 2019.

[16] Y. Yang, K. G. Vamvoudakis, H. Modares, W. He, Y. Xin, D. Wunsch, “Safe Intermittent Reinforcement Learning for Nonlinear Systems,” Proc. IEEE Conference on Decision and Control, pp. 690-697, Nice, France, 2019. (invited paper)

[17] V. G. Lopez, K. G. Vamvoudakis, Y. Wan, F. L. Lewis, “Off-Policy Reinforcement-Learning Algorithm to Solve Minimax Games on Graphs,” Proc. IEEE Conference on Decision and Control, pp. 6473-6478, Nice, France, 2019. (invited paper)

[18] J. I. Poveda, K. G. Vamvoudakis, M. Benosman, “CODES: Cooperative Data-Enabled Extremum Seeking for Multi-Agent Systems,” Proc. IEEE Conference on Decision and Control, pp. 2988-2993, Nice, France, 2019.

[19] J. I. Poveda, K. G. Vamvoudakis, M. Benosman, “DEES: A Class of Data-Enabled Robust Feedback Algorithms for Real-Time Optimization,” Proc. 11th IFAC Symposium on Nonlinear Control Systems (NolCoS), vol. 52, no. 16, pp.670-675, Vienna, Austria, 2019. (invited paper)

[20] K. G. Vamvoudakis, A. Kanellopoulos, “Non-Equilibrium Learning and Cyber-Physical Security,” Proc. 57th Annual Allerton Conference on Communication, Control, and Computing, pp. 1-6, Monticello, IL, 2019. (invited paper)

[21] Y. Zhou, K. G. Vamvoudakis, W. M. Haddad, Z. P. Jiang, “A Secure Control Learning Framework for Cyber-Physical Systems under Sensor Attacks,” Proc. American Control Conference, pp. 4280-4285, Philadelphia, PA, 2019.

[22] A. Kanellopoulos, K. G. Vamvoudakis, “Switching for Unpredictability: A Proactive Defense Control Approach,” Proc. American Control Conference, pp. 4338-4343, Philadelphia, PA, 2019.

[23] P. K. Gundu, K. G. Vamvoudakis, R. M. Gerdes, “An Intermittent Learning Algorithm for High-Speed Autonomous Driving in Unknown Environments,” Proc. American Control Conference, pp. 4286-4292, Philadelphia, PA, 2019.

[24] G. P. Kontoudis, K. G. Vamvoudakis, “Robust Kinodynamic Motion Planning using Model-Free Game-Theoretic Learning,” Proc. American Control Conference, pp. 273-278, Philadelphia, PA, 2019.

[25] Y. Yang, K. G. Vamvoudakis, H. Modares, W. He, Y. Xin, D. Wunsch, “Safety Aware Reinforcement Learning Framework with an Actor-Critic-Barrier Structure,” Proc. American Control Conference, pp. 2352-2358, Philadelphia, PA, 2019. (invited paper)

[26] G. P. Kontoudis, M. Liarokapis, K. G. Vamvoudakis, “Underactuated Finger for Anthropomorphic Hands,” Proc. IEEE-RAS-EMBS International Conference on Rehabilitation Robotics (ICORR), pp. 682-688, Toronto, Canada, 2019.

[27] A. Kanellopoulos, K. G. Vamvoudakis, Y. Wardi, “Predictive Learning via Lookahead Simulation,” Proc. AIAA SciTech Forum, 2019. (invited paper)

[28] Y. Yang, K. G. Vamvoudakis, H. Ferraz, H. Modares, “Dynamic Intermittent Q-Learning for Systems with Reduced Bandwidth,” Proc. IEEE Conference on Decision and Control, pp. 924-931, Miami, FL, 2018. (invited paper)

[29] D. Muniraj, K. G. Vamvoudakis, M. Farhood, “Enforcing Signal Temporal Logic Specifications in Multi-Agent Adversarial Environments: A Deep Q-learning Approach,” Proc. IEEE Conference on Decision and Control, pp. 4141-4146, Miami, FL, 2018.

[30] X. Jin, W. M. Haddad, Z. P. Jiang, K. G. Vamvoudakis, “Adaptive Control for Mitigating Sensor and Actuator Attacks in Connected Autonomous Vehicle Platoons,” Proc. IEEE Conference on Decision and Control, pp. 2810-2815, Miami, FL, 2018.

[31] M. Grammatopoulou, A. Kanellopoulos, K. G. Vamvoudakis, “A Multi-step and Resilient Predictive Q-learning Algorithm for IoT: A Case Study in Water Supply Networks,” Proc. International Conference on the Internet of Things (IoT), pp. 18:1-18:8, Santa Barbara, CA, 2018.

[32] A. Farahmandi, G. Hewer, B. Reitz, K. Estabridis, K. G. Vamvoudakis, “A Model Free Learning Algorithm to Control Autonomous Streams over IoT,” Proc. International Conference on the Internet of Things (IoT), pp. 33:1-33:4, Santa Barbara, CA, 2018.

[33] Y. Yang, K. G. Vamvoudakis, H. Modares, D. Ding, Y. X. Yin, D. Wunsch, “Dynamic Intermittent Suboptimal Control: Performance Quantification and Comparisons,” Proc. Chinese Control Conference, pp. 2017-2022, Wuhan, China, 2018.

[34] Y. Yang, H. Modares, K. G. Vamvoudakis, Y. X. Yin, D. Wunsch, “Model-Free Event-Triggered Containment Control of Multi-Agent Systems,” Proc. American Control Conference, pp. 877-884, Milwaukee, WI, 2018.

[35] K. D. Tsoukalas, G. P. Kontoudis, K. G. Vamvoudakis, “Active-Bayesian Learning for Cooperation Connectivity in Dynamic Cyber-Physical-Human Systems,” Proc. IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), Honolulu, HI, 2017. (invited paper)

[36] K. G. Vamvoudakis, F. R. Pour Safaei, “Stochastic Zero-Sum Nash Games for Uncertain Nonlinear Markovian Jump Systems,” Proc. 56th IEEE Conference on Decision and Control, pp. 5582-5589, Melbourne, Australia, 2017.

[37] J. I. Poveda, K. G. Vamvoudakis, M. Benosman, “A Neuro-Adaptive Architecture for Extremum Seeking Control Using Hybrid Learning Dynamics,” Proc. American Control Conference, pp. 542-547, Seattle, WA, 2017.

[38] J. Na, G. Herrmann, K. G. Vamvoudakis, “Adaptive Optimal Observer Design via Approximate Dynamic Programming,” Proc. American Control Conference, pp. 3288-3293, Seattle, WA, 2017.

[39] F. Tatari, M. B. Naghibi-Sistani, K. G. Vamvoudakis, “Distributed Optimal Synchronization Control of Linear Networked Systems under Unknown Dynamics,” Proc. American Control Conference, pp. 668-673, Seattle, WA, 2017.

[40] B. Kiumarsi, K. G. Vamvoudakis, H. Modares, F. L. Lewis, Advances in Reinforcement Learning Structures for Continuous-Time Dynamical Systems, Proc. 18th Yale Workshop on Adaptive and Learning Systems, Yale University, 2017. (invited paper)

[41] K. G. Vamvoudakis, H. Ferraz, “Event-Triggered H-infinity Control for Unknown Continuous-Time Systems Using Q-learning,” Proc. 55th IEEE Conference on Decision and Control, pp. 1376-1381, Las Vegas, NV, 2016.

[42] K. G. Vamvoudakis, “Game-Theoretic Tracking Control for Actuator Attack Attenuation in Cyber-Physical Systems,” Proc. International Joint Conference on Neural Networks (IJCNN), pp. 4233-4240, Vancouver, Canada, 2016. (invited paper)

[43] K. G. Vamvoudakis, “Optimal Trajectory Output Tracking Control with a Q-learning Algorithm,” Proc. American Control Conference, pp. 5752-5757, Boston, MA, 2016.

[44] M. F. Miranda, K. G. Vamvoudakis, “Online Optimal Auto-Tuning of PID Controllers for a Special Class of Linear Systems,” Proc. American Control Conference, pp. 5443-5448, Boston, MA, 2016.

[45] K. G. Vamvoudakis, P. J. Antsaklis, W. E. Dixon, J. P. Hespanha, F. L. Lewis, H. Modares, B. Kiumarsi, “Autonomy and Machine Intelligence in Complex Systems: A Tutorial,” Proc. American Control Conference, pp. 5062-5079, Chicago, IL, 2015. (invited 18 pages lead tutorial paper)

[46] K. G. Vamvoudakis, J. P. Hespanha, “Model-Free Plug-n-Play Optimization Techniques to Design Autonomous and Resilient Complex Systems,” Proc. American Control Conference, pp. 5081, Chicago, IL, 2015.

[47] Q. Jiao, H. Modares, S. Xu, F. L. Lewis, K. G. Vamvoudakis, “Disturbance Rejection of Multi-Agent Systems: A Reinforcement Learning Differential Game Approach,” Proc. American Control Conference, pp. 737-742, Chicago, IL, 2015.

[48] K. G. Vamvoudakis, J. P. Hespanha, “Online Optimal Switching of Single Phase DC/AC Inverters Using Partial Information,” Proc. American Control Conference, pp. 2624-2630, Portland, OR, 2014.

[49] K. G. Vamvoudakis, “An Online Actor/Critic Algorithm for Event-Triggered Optimal Control of Continuous-Time Nonlinear Systems,” Proc. American Control Conference, pp. 1-6, Portland, OR, 2014.

[50] K. G. Vamvoudakis, “Distributed Games for Multi-Agent Systems,” Proc. Agile Ground Vehicle Dynamics, Energy Efficiency, and Performance in Severe Environments: International Engineering Symposium, Birmingham, AL, 2013. (keynote invited speaker paper)

[51] M. I. Abouheaf, F. L. Lewis, S. Haesaert, R. Babuska, K. G. Vamvoudakis, “Multi-Agent Discrete-Time Graphical Games: Interactive Nash Equilibrium and Value Iteration Solution,” Proc. American Control Conference, pp. 4195-4201, Washington, DC, 2013.

[52] K. G. Vamvoudakis, L. R. Garcia Carrillo, J. P. Hespanha, “Learning Consensus in Adversarial Environments,” Proc. SPIE Defense, Security and Sensing, Baltimore, MD, 2013. (invited paper)

[53] K. G. Vamvoudakis, J. P. Hespanha, R. A. Kemmerer, G. Vigna, “Formulating Cyber-Security as Convex Optimization Problems,” Proc. Workshop on Control of Cyber-Physical Systems, Johns Hopkins University, 2013.

[54] K. G. Vamvoudakis, J. P. Hespanha, B. Sinopoli, Y. Mo, “Adversarial Detection as a Zero-Sum Game,” Proc. 51st IEEE Conference on Decision and Control, pp. 7133-7138, Maui, HI, 2012. (invited paper)

[55] K. G. Vamvoudakis, F. L. Lewis, M. Johnson, W. E. Dixon, “Online Learning Algorithm for Stackelberg Games in Problems with Hierarchy,” Proc. 51st IEEE Conference on Decision and Control, pp. 1883-1889, Maui, HI, 2012. (invited paper)

[56] K. G. Vamvoudakis, F. L. Lewis, “An Online Integral Reinforcement Learning Algorithm to Solve N-Player Nash Games,” Proc. IEEE Multi-Conference on Systems and Control, pp. 697-702, Dubrovnik, Croatia, 2012.

[57] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Adaptive Optimal Control Algorithm for Zero-Sum Nash Games with Integral Reinforcement Learning,” Proc. AIAA Guidance, Navigation, and Control Conference, Minneapolis, MN, 2012. (invited paper)

[58] K. G. Vamvoudakis, F. L. Lewis, “Policy Iteration Algorithm for Distributed Networks and Graphical Games,” Proc. 50th IEEE Conference on Decision and Control, pp. 128-135, Orlando, FL, 2011. (invited paper)

[59] K. G. Vamvoudakis, F. L. Lewis, “Non-Zero Sum Games: Online Learning Solution of Coupled Hamilton-Jacobi and Coupled Riccati Equations,” Proc. IEEE Multi-Conference on Systems and Control, pp. 171-178, Denver, CO, 2011. (invited paper)

[60] K. G. Vamvoudakis, F. L. Lewis, “Multi-Agent Differential Graphical Games,” Proc. 30th Chinese Control Conference, pp. 4932–4939, China, 2011.

[61] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, Online Learning of Optimal Control Solutions Using Integral Reinforcement Learning and Neural Networks, Proc. 15th Yale Workshop on Adaptive and Learning Systems, Yale University, 2011. (invited paper)

[62] K. G. Vamvoudakis, D.Vrabie, F. L. Lewis, “Online Adaptive Learning of Optimal Control Solutions Using Integral Reinforcement Learning,” Proc. IEEE Symp. Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), pp. 250-257, France, 2011. (invited paper)

[63] K. G. Vamvoudakis, M. A. Christodoulou, “Adaptive Backstepping Neural Network Control for Mechanical Pumps,” Proc. 4th Chaotic Modeling and Simulation International Conference (CHAOS), pp. 589-602, Crete, Greece, 2011.

[64] K. G. Vamvoudakis, M. A. Christodoulou, “Adaptive Control of Mixed-Interlaced forms,” Proc. 4th Chaotic Modeling and Simulation International Conference (CHAOS), pp. 603-616, Crete, Greece, 2011.

[65] K. G. Vamvoudakis, F. L. Lewis, “Online Solution of Nonlinear Two-Player Zero-Sum Games Using Synchronous Policy Iteration,” Proc. 49th IEEE Conference on Decision and Control, pp. 3040-3047, Atlanta, GA, 2010. (invited paper)

[66] K. G. Vamvoudakis, D. G. Mikulski, G. R. Hudas, F. L. Lewis, E. Y. Gu, “Distributed Games for Multi-Agent Systems: Games on Communication Graphs,” Proc. 27th Army Science Conference, Orlando, FL, 2010. (This paper won the best paper award.)

[67] G. Hudas, F. L. Lewis, K. G. Vamvoudakis, “Online Gaming for Learning Optimal Team Strategies in Real Time,” Proc. SPIE Defense, Security and Sensing, vol. 7692, 76920W, 2010. (invited paper)

[68] F. L. Lewis, K. G. Vamvoudakis, Optimal Adaptive Control for Unknown Systems Using Output Feedback by Reinforcement Learning Methods,” Proc. 8th IEEE International Conference on Control & Automation, pp. 2138 - 2145, Xiamen, China, 2010.

[69] K. G. Vamvoudakis, D.Vrabie, F. L. Lewis, Online Policy Iteration Based Algorithms to Solve the Continuous-Time Infinite Horizon Optimal Control Problem,” Proc. IEEE Symp. Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), pp. 36-41, Nashville, TN, 2009.

[70] K. G. Vamvoudakis,  F. L. Lewis, Online Actor Critic Algorithm to Solve the Continuous-Time Infinite Horizon Optimal Control Problem,” Proc. International Joint Conference on Neural Networks (IJCNN), pp. 3180-3187, Atlanta, GA, 2009. (invited paper and the most cited paper in IJCNN, Arnetminer, 2009-present)

[71] D.Vrabie, K. G. Vamvoudakis, F. L. Lewis, Adaptive Optimal Controllers Based on Generalized policy iteration in a Continuous-Time Framework,” Proc. IEEE Mediterranean Conference on Control and Automation, pp. 1402-1409, Thessaloniki, Greece, 2009. (invited paper)

[72] K. G. Vamvoudakis, M. A. Christodoulou, Adaptive Backstepping Control for MAPK Cascade Models Using RBF Neural Networks,” Proc. IEEE Mediterranean Conference on Control and Automation, Athens, Greece, 2007.

[73] K. G. Vamvoudakis, M. A. Christodoulou, “Backstepping, Interlaced and Mixed Interlaced Adaptive Nonlinear Control for Biological Models,” Proc. Intelligent Systems and Computing: Theory and Applications Conference (ISYC 06), pp. 196-219, Ayia Napa, Cyprus, 2006.

Other

[1] G. Cherubini, M. Guay, S. Tarbouriech, K. Ariyur, M. E. Broucke, S. Dey, C. Ebenbauer, P. Frasca, B. Gharesifard, A. Girard, J. M. Gomes da Silva, L. Grune, C. M. Kellett, U. Khan, G. Notarstefano, L. Scardovi, K. G. Vamvoudakis, Guest Editorial Introduction to the Special Issue of the IEEE L-CSS on Learning and Control,” IEEE Control Systems Letters, vol. 4, no. 3, pp. 710-712, 2020.

[2] K. G. Vamvoudakis, Y. Wan, F. L. Lewis, Chairs Report on the Workshop: Distributed Reinforcement Learning and Reinforcement-Learning Games,” IEEE Control Systems Magazine, vol. 39, no. 6, pp. 122-124, December 2019.

[3] K. G. Vamvoudakis, People in Control,” IEEE Control Systems Magazine, vol. 39, no. 5, pp. 31-33, October 2019.

[4] K. G. Vamvoudakis, S. Jagannathan, Chairs Report on the Workshop: Recent Advances and Future Directions on Adaptation and Control,” IEEE Control Systems Magazine, vol. 36, no. 2, pp. 128-130, 2016.

[5] K. G. Vamvoudakis, Optimal and Robust Scheduling for Networked Control Systems by Stefano Longo, Tingli Su, Guido Herrmann, and Phil Barber,” IEEE Control Systems Magazine, vol. 35, no. 2, pp. 101-103, 2015.

Proceedings and Reprint Volumes

[1] K. Janowicz, W. Kuhn, F. Cena, A. Haller, K. G. Vamvoudakis, Proceedings of the 8th International Conference on the Internet of Things (IoT),” Santa Barbara, California, Association for Computing Machinery (ACM), 2018.

Tutorials and Workshops

[1] K. G. Vamvoudakis, Recent Developments on Autonomy and Security of Cyber-Physical Systems, NSF CPS PI Meeting, Alexandria, VA, 2018. (invited speakers are: J. P. Hespanha, G. J. Pappas, P. Tabuada, R. Gerdes, F. Pasqualetti, Y. Wan)

[2] K. G. Vamvoudakis, J. P. Hespanha, Tutorial on Autonomy and Machine Intelligence in Complex Systems, American Control Conference, Chicago, IL, 2015. (invited speakers are: P. J. Antsaklis, W. E. Dixon, J. P. Hespanha, F. L. Lewis, K. G. Vamvoudakis)

[3] K. G. Vamvoudakis, S. Jagannathan, Workshop on Recent Advances and Future Directions on Adaptation and Control,” Chicago, IL, 2015.

[4] F. L. Lewis, K. G. Vamvoudakis, D. Vrabie, Optimal Control and Online Game Solutions Using Approximate Dynamic Programming, 50th IEEE Conference on Decision and Control (Workshop on Optimal Adaptive Control: Online Solutions for Optimal Feedback Control and Differential Games Using Reinforcement Learning), Orlando, FL, 2011.

[5] F. L. Lewis, K. G. Vamvoudakis, D. Vrabie, ADP for Control of Continuous-Time Dynamical Systems, Multi-Player Differential Games, and Games on Graphs, IEEE Symposium Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), Paris, France, 2011.

Posters

[1] K. G. Vamvoudakis, “Model-Free Online Optimal Adaptive Control and Non-Zero Sum Games with Applications to Network Security,” USC Workshop on Future Directions in Networks, Optimization & Controls, Los Angeles, CA, December 2014.

Technical Reports

[1] N. Stockman, K. G. Vamvoudakis, L. Devendorf, T. Höllerer, R. Kemmerer, J. P. Hespanha, “A Mission-Centric Visualization Tool for Cybersecurity Situation Awareness,” University of California, Santa Barbara, August 2012.

[2] K. G. Vamvoudakis, J. P. Hespanha, “Optimal Attacks for the iCTF Game,” University of California, Santa Barbara, July 2012.

Theses

[1] Doctoral Thesis: K. G. Vamvoudakis, Online Learning Algorithms for Differential Dynamic Games and Optimal Control, University of Texas at Arlington, May 2011.

[2] Diploma Thesis: K. G. Vamvoudakis, Adaptive Control for MAPK Cascade Models Using RBF Neural Networks, Technical University of Crete, June 2006.

My Erdös number

An upper bound on my Erdös number is 3 (one of the paths is given below).

[1] Y. Yang, H. Modares, K. G. Vamvoudakis, Y. X. Yin, D. Wunsch, “Model-Free Event-Triggered Containment Control of Multi-Agent Systems,” Proc. American Control Conference, pp. 877-884, 2018.

[2] F. Hanary, M.-H. Lim, A. Agarwal, D. Wunsch, “Algorithms for Derivation of Structurally Stable Hamiltonian Signed Graphs,” International Journal of Computer Mathematics, vol. 81, no. 11, pp. 1349-1356, 2004.

[3] P. Erdös, F. Hanary, W. T. Tutte, “On the Dimension of a Graph,” Mathematika, vol. 12, no. 2, pp. 118-122, 1965.