Kyriakos G. Vamvoudakis - Publications

Books

[1] F. L. Lewis, H. Modares, B. Kiumarsi, K. G. Vamvoudakis, A Course in Reinforcement Learning for Feedback Control, in preparation.

[2] Y. Wan, K. G. Vamvoudakis, Y. Chen, F. L. Lewis, Smarter Cyber-Physical Systems: Enabling Methodologies and Applications, to appear in, CRC Press, 2025.

[3] A. Kanellopoulos, L. Zhai, F. Fotiadis, K. G. Vamvoudakis, Control and Game Theoretic Methods for Cyber-Physical Security, Elsevier, 2024.

[4] K. G. Vamvoudakis, Y. Wan, F. L. Lewis, D. Cansever (Eds.), Handbook of Reinforcement Learning and Control, Springer, 2021.

[5] K. G. Vamvoudakis, N.-M. T. Kokolakis, Synchronous Reinforcement Learning-Based Control for Cognitive Autonomy, Foundations and Trends in Systems and Control, vol. 8, no. 1-2, pp. 1-175, 2020.

[6] K. G. Vamvoudakis, S. Jagannathan (Eds.), Control of Complex Systems: Theory and Applications, Elsevier, 2016.

[7] D. Vrabie, K. G. Vamvoudakis,  F. L. Lewis, Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles, Control Engineering Series, IET Press, 2012.

Read reviews of Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles written by Warren E. Dixon that appeared in IEEE Control Systems Magazine, vol. 34, no. 3, pp. 80-92, and Journal of Guidance, Control, and Dynamics, vol. 37, no. 3, pp. 1048-1049, 2014.

Patents

[1] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Optimal Online Adaptive Controller,” U.S. Patent No. 9,134,707, July 2015.

Journals

[1] J. Netter, K. G. Vamvoudakis, T. F. Walsch, J. Ray, “Safe and Robust Binary Classification and Fault Detection using Reinforcement Learning,” submitted, 2024.

[2] N. Tukenmez, F. Fotiadis, J. M. Magalhães Júnior, K. G. Vamvoudakis, S. Bogosyan, “Learning-based Trajectory Tracking Control of Microdrones in the Presence of Sparse Rewards,” submitted, 2024.

[3] V. John, K. G. Vamvoudakis, “Deception in Learning of Leader-Follower Games,” submitted, 2024.

[4] A. Wadi, K. G. Vamvoudakis, “Trajectory-Informed Machine Learning for Quantum Optimal Control of Uncertain Systems,” submitted, 2024.

[5] F. Fotiadis, A. Kanellopoulos, K. G. Vamvoudakis, U. Topcu, “Deception in Data-Driven Linear-Quadratic Control,” submitted, 2024.

[6] S. Chakraborty, W. Gao, K. G. Vamvoudakis, Z.-P. Jiang, “Active Learning-Based Control for Resiliency of Uncertain Systems Under DoS Attacks,” submitted, 2024.

[7] F. Fotiadis, K. G. Vamvoudakis, “Input-Output Data-Driven Sensor Selection for Cyber-Physical Systems,” submitted, 2024.

[8] A. S. Chen, G. Herrmann, K. G. Vamvoudakis, “Safe Optimal Observer Design via Q-Learning,” submitted, 2024.

[9] S. Chakraborty, W. Gao, K. G. Vamvoudakis, Z.-P. Jiang, “Adversarially Robust Learning-based Output Regulation Under Denial-of-Service Attacks,” submitted, 2024.

[10] F. Fotiadis, K. G. Vamvoudakis, “A Physics-Informed Learning Framework to Solve the Infinite-Horizon Optimal Control Problem,” submitted, 2024.

[11] N.-M. T. Kokolakis, Z. Zhang, K. G. Vamvoudakis, J. Darbon, G. Em. Karniadakis, “Safe Physics-Informed Machine Learning for Optimal Predefined-Time Stabilization: A Lyapunov-based Approach,” submitted, 2024.

[12] J. Netter, G. P. Kontoudis, K. G. Vamvoudakis, “Decentralized Multi-Agent Motion Planning using Cognitive Hierarchy and Gaussian Process Classification,” submitted, 2023.

[13] J. Cui, N.-M. T. Kokolakis, K. G. Vamvoudakis, P. Vela, “Multitask Transfer Learning with Dynamic Input Maps using Iterative Learning Control,” submitted, 2023.

[14] N.-M. T. Kokolakis, K. G. Vamvoudakis, W. M. Haddad, “Fixed-Time Learning for Safe Time-Critical Verification using Reachability Analysis,” submitted, 2023.

[15] N.-M. T. Kokolakis, K. G. Vamvoudakis, W. M. Haddad, “Online Learning-based Optimal Control of Nonlinear Systems with Fixed-Time Convergence Guarantees,” submitted, 2022.

[16] Y. Yang, H. Modares, K. G. Vamvoudakis, “Composite Adaptive Critic Design with Finite Excitation,” submitted, 2022.

[17] W. Gao, Y. Wang, K. G. Vamvoudakis, “Output-Feedback Learning-Based Control of Nonlinear Disturbed Systems,” submitted, 2022.

[18] T. Garg, S. Basu Roy, K. G. Vamvoudakis, “Robust Adaptive Extremum Seeking Control without Persistence of Excitation: From Theory to Experiment,” to appear in, International Journal of Robust and Nonlinear Control, 2024.

[19] M. Sarkar, X. Yan, B. Gebru, A.-R. Nuhu, K. Datta Gupta, K. G. Vamvoudakis, A. Homaifar, “A Data-Driven Approach for Performance Evaluation of Autonomous eVTOLs,” to appear in, IEEE Transactions on Aerospace and Electronic Systems, 2024.

[20] P. P. Sahoo, K. G. Vamvoudakis, “Self-Model-Free Learning versus Learning with External Rewards in Information Constrained Environments,” to appear in, IEEE Transactions on Artificial Intelligence, 2024.

[21] Z. Xu, G. P. Kontoudis, K. G. Vamvoudakis, “Online and Robust Intermittent Motion Planning in Dynamic and Changing Environments,” to appear in, IEEE Transactions on Neural Networks and Learning Systems, 2024.

[22] S. Kampezidou, J. Romberg, K. G. Vamvoudakis, D. Mavris, “Decentralized and Privacy-Preserving Learning of Approximate Stackelberg Solutions in Energy Trading Games with Demand Response Aggregators,” IEEE Transactions on Systems, Man and Cybernetics: Systems, vol. 54, no. 10, pp. 6304-6319, 2024.

[23] S. Niu, A. Bouland, H. Wang, F. Fotiadis, A. Kurdila, A. L'Afflitto, S. T. Paruchuri, K. G. Vamvoudakis, “Convergence Rates of Online Critic Value Function Approximation in Native Spaces,” IEEE Control Systems Letters, vol. 8, pp. 2145-2150, 2024.

[24] A. S. Chen, G. Herrmann, K. G. Vamvoudakis, J. Vijayan, “Learning-based Quantum Control for Optimal Pure State Manipulation,” IEEE Control Systems Letters, vol. 8, pp. 1319-1324, 2024.

[25] F. Fotiadis, A. Kanellopoulos, K. G. Vamvoudakis, J. Hugues, “On the Effect of Clock Offsets and Quantization on Learning-based Adversarial Games,” Automatica, vol. 167, paper 111762, 2024.

[26] J. M. Magalhães Júnior, G. L. O. Halila, K. G. Vamvoudakis, “Data-Driven Controller and Multi-Gradient Search Algorithm for Morphing Airfoils in High Reynolds Number Flows,” Aerospace Science and Technology, vol. 148, paper 109106, 2024.

[27] F. Fotiadis, K. G. Vamvoudakis, Z.-P. Jiang, “Data-Driven Actuator Allocation for Actuator Redundant Systems,” IEEE Transactions on Automatic Control, vol. 69, no. 4, pp. 2249-2264, 2024. (This paper is listed in the Top 50 most accessed articles, IEEE Transactions on Automatic Control, April 2024)

[28] S. P. Haeri Boroujeni, A. Razi, S. Khoshdel, F. Afghah, J. L. Coen, L. O'Neil, P. Fule, A. Watts, N.-M. T. Kokolakis, K. G. Vamvoudakis, “A Comprehensive Survey of Research Towards AI-enabled Unmanned Aerial Systems in Pre-, Active-, and Post-Wildfire Management,” Information Fusion, vol. 108, paper 102369, 2024.

[29] L. Somers, W. M. Haddad, N.-M. T. Kokolakis, K. G. Vamvoudakis, “Online Accelerated Data-Driven Learning for Optimal Feedback Control of Discrete-Time Partially Uncertain Systems,” International Journal of Adaptive Control and Signal Processing, vol. 38, no. 3, pp. 848-876, 2024.

[30] N.-M. T. Kokolakis, K. G. Vamvoudakis, “Safety-Aware Pursuit-Evasion Games in Unknown Environments using Gaussian Processes and Finite-Time Convergent Reinforcement Learning,” IEEE Transactions on Neural Networks and Learning Systems (Special Issue on Reinforcement Learning Based Control: Data-Efficient and Resilient Methods), vol. 35, no. 3, pp. 3130-3143, 2024.

[31] H. A. Hashim, A. E. E. Eltoukhy, K. G. Vamvoudakis, “UWB Ranging and IMU Data Fusion: Overview and Nonlinear Stochastic Filter for Inertial Navigation,” IEEE Transactions on Intelligent Transportation Systems, vol. 25, no. 1, pp. 359-369, 2024.

[32] Y. Yang, H. Modares, K. G. Vamvoudakis, F. L. Lewis, “Cooperative Finitely Excited Learning for Dynamical Games,” IEEE Transactions on Cybernetics, vol. 54, no. 2, pp. 797-810, 2024. (This paper is listed in the Top 50 most accessed articles, IEEE Transactions on Cybernetics, July 2023)

[33] H. Hashim, K. G. Vamvoudakis, “Adaptive Neural Network Stochastic-Filter-Based Controller for Attitude Tracking With Disturbance Rejection,” IEEE Transactions on Neural Networks and Learning Systems, vol. 35, no.1, pp. 1217-1227, 2024.

[34] B. Vundurthy, A. Kanellopoulos, V. Gupta, K. G. Vamvoudakis, “Intelligent Players in a Fictitious Play Framework,” IEEE Transactions on Automatic Control, vol. 69, no. 1, pp. 479-486, 2024.

[35] F. Fotiadis, K. G. Vamvoudakis, “Learning-based Actuator Selection for Increased Attack Resilience of Uncertain Systems,” Automatica, vol. 159, paper 111332, 2024.

[36] M. Abouheaf, M. Mayyas, H. Hashim, K. G. Vamvoudakis, “An Online Model-Following Projection Mechanism using Reinforcement Learning,” IEEE Transactions on Automatic Control, vol. 68, no. 11, pp. 6959-6966, 2023.

[37] F. Fotiadis, K. G. Vamvoudakis, “Recursive Reasoning with Reduced Complexity and Intermittency for Non-Equilibrium Learning in Stochastic Games,” IEEE Transactions on Neural Networks and Learning Systems, vol. 34, no. 11, pp. 8467-8481, 2023.

[38] O. Qasem, W. Gao, K. G. Vamvoudakis, “Adaptive Optimal Control of Continuous-Time Nonlinear Systems via Hybrid Iteration,” Automatica, vol. 157, paper 111261, 2023.

[39] P. P. Sahoo, A. Kanellopoulos, K. G. Vamvoudakis, “Intermittent Learning Through Operant Conditioning for Cyber-Physical Systems,” IEEE Transactions on Neural Networks and Learning Systems, vol. 34, no. 6, pp. 3124-3134, 2023.

[40] F. Fotiadis, K. G. Vamvoudakis, “Concurrent Receding Horizon Control and Estimation against Stealthy Attacks,” IEEE Transactions on Automatic Control, vol. 68, no. 6, pp. 3712-3719, 2023.

[41] N.-M. T. Kokolakis, K. G. Vamvoudakis, “Bounded Rational Dubins Vehicle Coordination for Target Tracking using Reinforcement Learning,” Automatica, vol. 149, paper 110732, 2023.

[42] Y. Yang, H. Modares, K. G. Vamvoudakis, W. He, C.-Z. Cu, D. Wunsch, “Hamiltonian-driven Adaptive Dynamic Programming with Approximation Errors,” IEEE Transactions on Cybernetics, vol. 52, no. 12, pp. 13762-13773, 2022.

[43] A. Kanellopoulos, K. G. Vamvoudakis, “Bounded Rationality in Byzantine Sensors under Attacks,” IEEE Transactions on Automatic Control, vol. 67, no. 7, pp. 3606-3613, 2022.

[44] K. G. Vamvoudakis, F. Fotiadis, A. Kanellopoulos, N.-M. T. Kokolakis, “Nonequilibrium Dynamical Games: A Control Systems Perspective,” Annual Reviews in Control, vol. 53, pp. 6-18, 2022.

[45] J. M. Magalhães Júnior, G. L. O. Halila, Y. Kim, T. Khamvilai, K. G. Vamvoudakis, “Intelligent Data-driven Aerodynamic Analysis and Optimization of Morphing Configurations,” Aerospace Science and Technology, vol. 121, pp. 107388, 2022.

[46] H. Hashim, M. Abouheaf, K. G. Vamvoudakis, “Neuro-Adaptive Stochastic Attitude Filter on SO(3),” IEEE Control Systems Letters, vol. 6, pp. 1549-1554, 2022.

[47] Y. Zhou, K. G. Vamvoudakis, W. M. Haddad, Z.-P. Jiang, “A Secure Control Learning Framework for Cyber-Physical Systems under Sensor and Actuator Attacks,” IEEE Transactions on Cybernetics, vol. 51, no. 9, pp. 4648-4660, 2021.

[48] Y. Yang, K. G. Vamvoudakis, H. Modares, Y. X. Yin, D. Wunsch, “Hamiltonian-Driven Hybrid Adaptive Dynamic Programming,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 51, no. 10, pp. 6423-6434, 2021.

[49] J. I. Poveda, M. Benosman, K. G. Vamvoudakis, “Data-Enabled Extremum Seeking: A Cooperative Concurrent Learning-Based Approach,” International Journal of Adaptive Control and Signal Processing (Special Issue on Extremum Seeking Control: Theory and Applications), vol. 35, no. 7, pp. 1256-1284, 2021.

[50] F. Fotiadis, K. G. Vamvoudakis, “Detection of Actuator Faults for Continuous-Time Systems with Intermittent State Feedback,” Systems and Control Letters, vol. 152, pp. 104938, 2021. (This paper is No. 16 in the Top 25 most popular articles in Systems and Control Letters, July 2021)

[51] L. Zhai, K. G. Vamvoudakis, “A Data-Based Private Learning Approach for Enhanced Security against Replay Attacks in Cyber-Physical Systems,” International Journal of Robust and Nonlinear Control (Special Issue on Optimal Control and Learning for Cyber-Physical Systems), vol. 31, no. 6, pp. 1817-1833, 2021.

[52] A. Chakrabarty, D. K. Jha, G. T. Buzzard, Y. Wang, K. G. Vamvoudakis, “Safe Approximate Dynamic Programming via Kernelized Lipschitz Estimation,” IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 1, pp. 405-419, 2021.

[53] L. Zhai, K. G. Vamvoudakis, “Data-Based and Secure Switched Cyber-Physical Systems,” Systems and Control Letters, vol. 148, pp. 104829, 2021. (This paper is No. 7 in the Top 25 most popular articles in Systems and Control Letters, April 2021)

[54] Y. Yang, K. G. Vamvoudakis, H. Modares, W. He, Y. Yin, D. Wunsch, “Safe Intermittent Reinforcement Learning with Static and Dynamic Event Generators,” IEEE Transactions on Neural Networks and Learning Systems, vol. 31, no. 12, pp. 5441-5455, 2020.

[55] S. Luo, F. L. Lewis, Y. Song, K. G. Vamvoudakis, “Adaptive Backstepping Optimal Control of a Fractional-Order Chaotic Magnetic-Field Electromechanical Transducer,” Nonlinear Dynamics, vol. 100, no. 1, pp. 523-540, 2020.

[56] Y. Yang, H. Modares, K. G. Vamvoudakis, Y. Yin, D. Wunsch, “Dynamic Intermittent Feedback Design for H-infinity Containment Control on a Directed Graph,” IEEE Transactions on Cybernetics, vol. 50, no. 8, pp. 3752-3765, 2020.

[57] P. P. Sahoo, K. G. Vamvoudakis, “On-Off Adversarially Robust Q-Learning,” IEEE Control Systems Letters (Special Issue on Learning and Control), vol. 4, no. 3, pp. 749-754, 2020. (This paper is listed in the Top 50 most accessed articles, IEEE Control Systems Letters, May 2020)

[58] Y. Yang, K. G. Vamvoudakis, H. Modares, “Safe Reinforcement Learning for Dynamical Games,” International Journal of Robust and Nonlinear Control, vol. 30, no. 9, pp. 3706-3726, 2020. (This paper also appeared as the cover image for the issue. This paper is a Top 10 most read Paper, International Journal of Robust and Nonlinear Control, June 2022)

[59] L. R. Garcia Carrillo, K. G. Vamvoudakis, “Deep-Learning Tracking for Autonomous Flying Systems under Adversarial Inputs,” IEEE Transactions on Aerospace and Electronic Systems, vol. 56, no. 2, pp. 1444-1459, 2020.

[60] A. Kanellopoulos, K. G. Vamvoudakis, “A Moving Target Defense Control Framework for Cyber-Physical Systems,” IEEE Transactions on Automatic Control, vol. 65, no. 3, pp. 1029-1043, 2020. (This paper is listed in the Top 50 most accessed articles, IEEE Transactions on Automatic Control, June 2020)

[61] G. P. Kontoudis, K. G. Vamvoudakis, “Kinodynamic Motion Planning with Q-Learning: An Online, Model-Free, and Safe Navigation Framework,” IEEE Transactions on Neural Networks and Learning Systems, vol. 30, no. 12, pp. 3803-3817, 2019.

[62] X. Jin, W. M. Haddad, Z.-P. Jiang, A. Kanellopoulos, K. G. Vamvoudakis, “An Adaptive Learning and Control Architecture for Mitigating Sensor and Actuator Attacks in Connected Autonomous Vehicle Platoons,” International Journal of Adaptive Control and Signal Processing (Special Issue on Learning From Adaptive Control Under Relaxed Excitation Conditions), vol. 33, no. 12, pp. 1788-1802, 2019. (This paper is a Top 10 most read paper, International Journal of Adaptive Control and Signal Processing, June 2022)

[63] F. Tatari, K. G. Vamvoudakis, M. Mazouchi, “Optimal Distributed Learning for Disturbance Rejection in Networked Nonlinear Games under Unknown Dynamics,” IET Control Theory and Applications (Special Issue on Distributed Optimization and Learning for Networked Systems), vol. 13, no. 17, pp. 2838-2848, 2019.

[64] T. Attia, K. G. Vamvoudakis, K. Kochersberger, J. Bird, T. Furukawa, “Dynamical Estimation and Optimal Control of Vehicle Active Suspensions,” Vehicle System Dynamics, vol. 57, no. 10, pp. 1467-1493, 2019.

[65] G. P. Kontoudis, M. Liarokapis, K. G. Vamvoudakis, T. Furukawa, “An Adaptive Actuation Mechanism for Anthropomorphic Robot Hands,” Frontiers in Robotics and AI: Soft Robotics (Special Issue on Human-like Robotic Hands for Biomedical Applications and Beyond), vol. 6, no. 47, pp. 1-16, 2019.

[66] K. G. Vamvoudakis, F. R. Pour Safaei, J. P. Hespanha, “Robust Event-Triggered Output Feedback Learning Algorithm for Voltage Source Inverters with Unknown Load and Parameter Variations,” International Journal of Robust and Nonlinear Control, vol. 29, no. 11, pp. 3502-3517, 2019.

[67] D. A. Copp, K. G. Vamvoudakis, J. P. Hespanha, “Distributed Output-Feedback Model Predictive Control,” Systems and Control Letters, vol. 127, pp. 52-59, 2019. (This paper is No. 3 in the Top 25 most popular articles in Systems and Control Letters, June 2019)

[68] Y. Yang, K. G. Vamvoudakis, H. Ferraz, H. Modares, “Dynamic Intermittent Q-learning-Based Model-Free Suboptimal Co-Design of L2-Stabilization,” International Journal of Robust and Nonlinear Control, vol. 29, no. 9, pp. 2673-2694, 2019.

[69] A. Kanellopoulos, K. G. Vamvoudakis, “Non-Equilibrium Dynamic Games and Cyber-Physical Security: A Cognitive Hierarchy Approach,” Systems and Control Letters, vol. 125, pp. 59-66, 2019. (This paper is No. 12 in the Top 25 most popular articles in Systems and Control Letters, June 2019)

[70] K. G. Vamvoudakis, F. L. Lewis, W. E. Dixon, “Open-Loop Stackelberg Learning Solution for Hierarchical Control Problems,” International Journal of Adaptive Control and Signal Processing (Special Issue on Learning-Based Adaptive Control: Theory and Applications), vol. 33, no. 2, pp. 285-299, 2019. (This paper is a Top 20 most read paper, International Journal of Adaptive Control and Signal Processing, June 2019)

[71] B. Kiumarsi, K. G. Vamvoudakis, H. Modares, F. L. Lewis, “Optimal and Autonomous Control using Reinforcement Learning: A Survey,” IEEE Transactions on Neural Networks and Learning Systems (Special Issue on Deep Reinforcement Learning and Adaptive Dynamic Programming), vol. 29, no. 6, pp. 2042-2062, 2018. (This paper is listed as a Publication Spotlight paper of the IEEE Computational Intelligence Society. This paper is No. 2 in the Top 50 most accessed articles, IEEE Transactions on Neural Networks and Learning Systems, August 2018)

[72] K. G. Vamvoudakis, J. P. Hespanha, “Cooperative Q-learning for Rejection of Persistent Adversarial Inputs in Unknown Networked Systems,” IEEE Transactions on Automatic Control, vol. 63, no. 4, pp. 1018-1031, 2018. (This paper is listed in the Top 50 most accessed articles, IEEE Transactions on Automatic Control, April 2018)

[73] K. G. Vamvoudakis, J. P. Hespanha, “Game-Theory-Based Consensus Learning of Double-Integrator Agents in the Presence of Worst-Case Adversaries,” Journal of Optimization Theory and Applications, vol. 177, no. 1, pp. 222-253, 2018.

[74] K. G. Vamvoudakis, H. Ferraz, “Model-Free Event-Triggered Control Algorithm for Continuous-Time Linear Systems with Optimal Performance,” Automatica, vol. 87, pp. 412-420, 2018. (This paper is No. 21 in the Top 25 most accessed articles, Automatica, June 2018)

[75] K. G. Vamvoudakis, “Q-learning for Continuous-Time Graphical Games on Large Networks with Completely Unknown System Dynamics,” International Journal of Robust and Nonlinear Control, vol. 27, no. 16, pp. 2900-2920, 2017.

[76] K. G. Vamvoudakis, J. P. Hespanha, “Online Optimal Operation of Parallel Voltage Source Inverters using Partial Information,” IEEE Transactions on Industrial Electronics (Special Issue on Data Driven Control and Learning Systems), vol. 64, no. 5, pp. 4296-4305, 2017.

[77] K. G. Vamvoudakis, H. Modares, B. Kiumarsi, F. L. Lewis, “Game Theory-Based Control System Algorithms with Real-Time Reinforcement Learning,” IEEE Control Systems Magazine (Special Issue on Game-Theoretical Methods in Control Systems), vol. 37, no. 1, pp. 33-52, 2017. (This paper is No. 1 in the Top 50 most accessed articles, IEEE Control Systems, February 2017)

[78] K. G. Vamvoudakis, “Q-learning for Continuous-Time Linear Systems: A Model Free Infinite Horizon Optimal Control Approach,” Systems and Control Letters, vol. 100, pp. 14-20, 2017. (This paper is No. 1 in the Top 25 most popular articles in Systems and Control Letters, May 2017)

[79] K. G. Vamvoudakis, A. Mojoodi, H. Ferraz, “Event-Triggered Optimal Tracking Control of Nonlinear Systems,” International Journal of Robust and Nonlinear Control, vol. 27, no. 5, pp. 598-619, 2017.

[80] F. Tatari, M. B. Naghibi-Sistani, K. G. Vamvoudakis, “Distributed Learning Algorithm for Nonlinear Differential Graphical Games,” Transactions of the Institute of Measurement and Control, vol. 39, no. 2, pp. 173-182, 2017.

[81] K. G. Vamvoudakis, M. F. Miranda, J. P. Hespanha, “Asymptotically-Stable Optimal Adaptive Control Algorithm with Saturating Actuators and Relaxed Persistence of Excitation,” IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 11, pp. 2386-2398, 2016. (This paper is in the Top 50 most popular articles in IEEE Transactions on Neural Networks, October 2016)

[82] L. R. Garcia Carrillo, K. G. Vamvoudakis, J. P. Hespanha, “Approximate Optimal Adaptive Control for Weakly Coupled Nonlinear Systems: A Neuro-Inspired Approach,” International Journal of Adaptive Control and Signal Processing (Special Issue on From Adaptive Control to Variable Structure Systems: Seeking for Harmony), vol. 30, no. 8-10, pp. 1494-1522, 2016.

[83] Q. Jiao, H. Modares, S. Xu, F. L. Lewis, K. G. Vamvoudakis, “Multi-Agent Zero-Sum Differential Graphical Games for Disturbance Rejection in Cooperative Control,” Automatica, vol. 62, pp. 24-34, 2016. (This paper was included in the most downloaded articles from Automatica in 2016)

[84] K. G. Vamvoudakis, “Non-Zero Sum Nash Q-learning for Unknown Deterministic Continuous-Time Linear Systems,” Automatica, vol. 61, pp. 274-281, 2015.

[85] K. G. Vamvoudakis, “Event-Triggered Optimal Adaptive Control Algorithm for Continuous-Time Nonlinear Systems,” IEEE/CAA Journal of Automatica Sinica (Special Issue on Extensions of Reinforcement Learning and Adaptive Control), vol. 1, no. 3, pp. 282-293, 2014. (This paper was No. 8 in the Top 50 most popular articles in IEEE/CAA Journal of Automatica Sinica, February 2015)

[86] M. I. Abouheaf, F. L. Lewis, K. G. Vamvoudakis, S. Haesaert, R. Babuska, “Multi-Agent Discrete-Time Graphical Games and Reinforcement Learning Solutions,” Automatica, vol. 50, no. 12, pp. 3038-3053, 2014.

[87] K. G. Vamvoudakis, J. P. Hespanha, B. Sinopoli, Y. Mo, “Detection in Adversarial Environments,” IEEE Transactions on Automatic Control (Special Issue on Control of Cyber-Physical Systems), vol. 59, no. 12, pp. 3209-3223, 2014. (This paper was No. 12 in the Top 50 most popular articles in IEEE Transactions on Automatic Control, December 2014)

[88] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Online Learning Algorithm for Optimal Control with Integral Reinforcement Learning,” International Journal of Robust and Nonlinear Control, vol. 24, no. 17, pp. 2686-2710, 2014.

[89] S. Bhasin, R. Kamalapurkar, M. Johnson, K. G. Vamvoudakis, F. L. Lewis, W. E. Dixon, “A Novel Actor-Critic-Identifier Architecture for Approximate Optimal Control of Uncertain Nonlinear Systems,” Automatica, vol. 49, no. 1, pp. 82-92, 2013. (This paper is listed in the most cited Automatica articles published since 2013)

[90] F. L. Lewis, D. Vrabie, K. G. Vamvoudakis, “Reinforcement Learning and Feedback Control: using Natural Decision Methods to Design Optimal Adaptive Controllers,” IEEE Control Systems Magazine, vol. 32, no. 6, pp. 76-105, 2012. (This paper is consistently listed in the Top 50 most accessed articles, IEEE Control Systems, 2013-present)

[91] K. G. Vamvoudakis, F. L. Lewis, G. R. Hudas, “Multi-Agent Differential Graphical Games: Online Adaptive Learning Solution for Synchronization with Optimality,” Automatica, vol. 48, no. 8, pp. 1598-1611, 2012. (This paper was No. 5 in the Top 25 Hottest Articles in Automatica, Elsevier, September 2012)

[92] K. G. Vamvoudakis, F. L. Lewis, “Online Neural Network Solution of Nonlinear Two-Player Zero-Sum Games using Synchronous Policy Iteration,” International Journal of Robust and Nonlinear Control, vol. 22, no. 13, pp. 1460-1483, 2012.

[93] K. G. Vamvoudakis, M. A. Christodoulou, “Adaptive Control of Mixed-Interlaced forms,” Chaotic Modeling and Simulation Journal: International Journal of Nonlinear Science, July 2012 Issue, pp. 526-542, 2012.

[94] K. G. Vamvoudakis, M. A. Christodoulou, “Adaptive Backstepping Neural Network Control for Mechanical Pumps,” Chaotic Modeling and Simulation Journal: International Journal of Nonlinear Science, January 2012 Issue, pp. 109-122, 2012.

[95] G. Hudas, K. G. Vamvoudakis, D. Mikulski, F. L. Lewis, “Online Adaptive Learning for Team Strategies in Multi-Agent Systems,” The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology (Special Issue on Intelligent Behaviors in Tactical Unmanned Systems), vol. 9, no. 1, pp. 59-69, 2012. (This paper was the Most-Read Article, SAGE Journals, 2012-2014)

[96] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Online Learning Algorithm for Zero-Sum Games with Integral Reinforcement Learning,” Journal of Artificial Intelligence and Soft Computing Research, vol. 1, no. 4, pp. 315-332, 2011.

[97] K. G. Vamvoudakis, F. L. Lewis, “Multi-Player Non Zero-Sum Games: Online Adaptive Learning Solution of Coupled Hamilton-Jacobi Equations,” Automatica, vol. 47, no. 8, pp. 1556-1569, 2011. (This paper was No. 17 in the Top 25 Hottest Articles in Automatica, Elsevier, September 2011)

[98] F. L. Lewis, K. G. Vamvoudakis, “Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming using Measured Output Data,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 41, no. 1, pp. 14-25, 2011. (This paper is the Top Article in Computational Intelligence, BioMedLib, February 2011-2017)

[99] K. G. Vamvoudakis, F. L. Lewis, “Online Actor-Critic Algorithm to Solve the Continuous-Time Infinite Horizon Optimal Control Problem,” Automatica, vol. 46, no. 5, pp. 878-888, 2010. (This paper is selected to be included in the Virtual Special Issue of Annual Reviews in Control, as one of the papers with the highest citation rates in the control field. This paper is in the list of the most cited Automatica articles published after 2009 according to Scopus. This paper was No. 23 in the Top 25 Articles in Automatica, Elsevier, September 2010)

Chapters and Contributions in Books

[1] K. G. Vamvoudakis, “Multi Agent Q-learning with Adversaries in Nash Equilibrium and Non Equilibrium Settings,” to appear in, Encyclopedia of Systems and Control Engineering, ed. Z. Ding, Elsevier, 2025.

[2] A. Kanellopoulos, C. Mavridis, K. G. Vamvoudakis, J. S. Baras, K. H. Johansson, “Online Identification of Adversarial Cognitive Ability in Dynamic Games,” to appear in, Smarter Cyber-Physical Systems: Enabling Methodologies and Applications, eds. Y. Wan, K. G. Vamvoudakis, Y. Chen, F. L. Lewis, CRC Press, 2024.

[3] F. Fotiadis, L. Zhai, K. G. Vamvoudakis, J. Hugues, “On the Impact of Sensor-Actuator Clock Offsets on Off-Policy Reinforcement Learning,” to appear in, Smarter Cyber-Physical Systems: Enabling Methodologies and Applications, eds. Y. Wan, K. G. Vamvoudakis, Y. Chen, F. L. Lewis, CRC Press, 2024.

[4] K. G. Vamvoudakis, F. L. Lewis, D. Vrabie, “Reinforcement Learning with Applications in Autonomous Control and Game Theory,” in Handbook on Computer Learning and Intelligence, ed. P. Angelov, Chapter 19, World Scientific, 2022.

[5] G. P. Kontoudis, K. G. Vamvoudakis, Z. Xu, “RRT-QX: Real-Time Kinodynamic Motion Planning in Dynamic Environments with Continuous-Time Reinforcement Learning,” in Brain and Cognitive Intelligence-Control in Robotics, ed. B. Wei, Chapter 1, CRC Press, 2022.

[6] N.-M. T. Kokolakis, A. Kanellopoulos, K. G. Vamvoudakis, “Bounded Rationality in Differential Games: A Reinforcement Learning-Based Approach,” in Handbook of Reinforcement Learning and Control, eds. K. G. Vamvoudakis, Y. Wan, F. L. Lewis, D. Cansever, Chapter 16, Springer-Verlag, Berlin, 2021.

[7] A. Kanellopoulos, K. G. Vamvoudakis, V. Gupta, P. Antsaklis, “Dissipativity-Based Verification for Autonomous Systems in Adversarial Environments,” in Handbook of Reinforcement Learning and Control, eds. K. G. Vamvoudakis, Y. Wan, F. L. Lewis, D. Cansever, Chapter 10, Springer-Verlag, Berlin, 2021.

[8] F. L. Lewis, K. G. Vamvoudakis, “Neuro-Inspired Control,” in Encyclopedia of Systems and Control, eds. Tariq Samad, John Baillieul, Springer-Verlag, Berlin, 2020.

[9] K. G. Vamvoudakis, “Model-Free Reinforcement Learning-Based Control for Continuous-Time Systems,” in Encyclopedia of Systems and Control, eds. Tariq Samad, John Baillieul, Springer-Verlag, Berlin, 2020.

[10] A. Kanellopoulos, K. G. Vamvoudakis, “Entropy-Based Proactive and Reactive Cyber-Physical Security,” in Foundations and Challenges in Proactive Network Defense, eds. Z. Lu, C. Wang, Chapter 3, Springer, 2019.

[11] H. Modares, B. Kiumarsi, K. G. Vamvoudakis, F. L. Lewis, “Adaptive H-infinity Tracking Control of Nonlinear Systems using Reinforcement Learning,” in Adaptive Learning Methods for Nonlinear System Modeling, eds. D. Comminiello, J. Principe, Chapter 14, Elsevier, 2018.

[12] K. G. Vamvoudakis, “Model-Free Learning of Nash Games with Applications to Network Security,” in Control of Complex Systems: Theory and Applications, eds. K. G. Vamvoudakis, S. Jagannathan, Chapter 10, Elsevier, 2016.

[13] K. G. Vamvoudakis, S. Jagannathan, “Introduction to Complex Systems and Feedback Control,” in Control of Complex Systems: Theory and Applications, eds. K. G. Vamvoudakis, S. Jagannathan, Chapter 1, Elsevier, 2016.

[14] K. G. Vamvoudakis, F. L. Lewis, D. Vrabie, “Reinforcement Learning with Applications in Automation Decision and Feedback Control,” in Handbook on Computational Intelligence, ed. P. Angelov, Chapter 12, World Scientific, 2016.

[15] K. G. Vamvoudakis, G. R. Hudas, “Past, Present and Future of Control Theory Applied to Autonomous Vehicles/Agents in Severe Conditions,” in Advanced Autonomous Vehicle Design for Severe Environments, eds. V. Vantsevich, M. Blundell, Chapter 1, NATO ASI Series, IOS Press, Amsterdam, 2015.

[16] K. G. Vamvoudakis, G. R. Hudas, “Terrorist Threats, Agile Vehicle Trajectory Deviation and Critical Reposition in Interaction with Environment,” in Advanced Autonomous Vehicle Design for Severe Environments, eds. V. Vantsevich, M. Blundell, Chapter 2, NATO ASI Series, IOS Press, Amsterdam, 2015.

[17] K. G. Vamvoudakis, G. R. Hudas, “New Methods and Techniques in Online Control and Learning,” in Advanced Autonomous Vehicle Design for Severe Environments, eds. V. Vantsevich, M. Blundell, Chapter 7, NATO ASI Series, IOS Press, Amsterdam, 2015.

[18] F. L. Lewis, K. G. Vamvoudakis, “Neural Control and Approximate Dynamic Programming,” in Encyclopedia of Systems and Control, eds. Tariq Samad, John Baillieul, Springer-Verlag, Berlin, 2015.

[19] K. G. Vamvoudakis,  F. L. Lewis, Shuzhi Sam Ge, “Neural Networks in Feedback Control Systems,” in Mechanical Engineers’ Handbook, Volume 2, Design, Instrumentation, and Controls, 4th Edition, ed. Myer Kutz, Chapter 23, John Willey, NY, 2015.

[20] K. G. Vamvoudakis, J. P. Hespanha, R. A. Kemmerer, G. Vigna, “Formulating Cyber-Security as Convex Optimization Problems,” in Control of Cyber-Physical Systems, Lecture Notes in Control and Information Sciences, ed. Danielle Tarraf, Volume 449, pp. 85-100, Springer-Verlag, Berlin, 2013.

[21] K. G. Vamvoudakis,  F. L. Lewis, “Online Learning Algorithms for Optimal Control and Dynamic Games,” in Reinforcement Learning and Approximate Dynamic Programming for Feedback Control, eds. F. L. Lewis, D. Liu, Chapter 16, IEEE Press Computational Intelligence Series, 2013.

[22] S. Bhasin, R. Kamalapurkar, M. Johnson, K. G. Vamvoudakis,  F. L. Lewis, W. Dixon, “An Actor-Critic-Identifier Architecture for Adaptive Approximate Optimal Control,” in Reinforcement Learning and Approximate Dynamic Programming for Feedback Control, eds. F. L. Lewis, D. Liu, Chapter 12, IEEE Press Computational Intelligence Series, 2013.

[23] K. G. Vamvoudakis,  F. L. Lewis, “Online Adaptive Learning Solution of Multi-Agent Differential Graphical Games,” in Frontiers in Advanced Control Systems, ed. Ginalber Luiz Serra, Chapter 2, INTECH, 2012. (This book chapter has been accessed more than 3000 times, INTECH, 2016)

[24] K. G. Vamvoudakis,  F. L. Lewis, “Online Gaming: Real Time Solution of Nonlinear Two-Player Zero-Sum Games using Synchronous Policy Iteration,” in Advances in Reinforcement Learning, ed. Abdelhamid Mellouk, Chapter 18, INTECH, 2011. (This book chapter has been accessed more than 3000 times, INTECH, 2014)

[25] K. G. Vamvoudakis,  F. L. Lewis, “Online Synchronous Policy Iteration Method for Optimal Control,” in Recent Advances in Intelligent Control Systems, ed. Wen Yu, Chapter 14, Springer-Verlag, Berlin, 2009.

Conferences

[1] K. G. Vamvoudakis, F. Fotiadis, T. Başar, V. Gupta, J. Poveda, M. Tang, M. Krstic, Q. Zhu, “Deception in Game Theory and Control: A Tutorial,” submitted, 2024.

[2] S. Athalye, K. G. Vamvoudakis, P. J. Antsaklis, “Synthesis of Interacting Model-Based and Model-Free Components for Optimal Control,” submitted, 2024.

[3] A. Wadi, K. G. Vamvoudakis, “Trajectory-Informed versus Physics-Informed Machine Learning Methods for Dynamic Zero-Sum Games,” submitted, 2024.

[4] V. John, K. G. Vamvoudakis, “Deception in Learning of Games: A Closed-Loop Stackelberg Game Analysis,” submitted, 2024.

[5] M. S. Ramadan, M. A. Hayajnh, M. T. Tolley, K. G. Vamvoudakis, “Actively Learning Reinforcement Learning: A Stochastic Optimal Control Approach,” submitted, 2024.

[6] F. Fotiadis, K. G. Vamvoudakis, “Input-Output Data-Driven Sensor Selection,” to appear in, IEEE Conference on Decision and Control, Milan, Italy, 2024. (invited paper)

[7] F. Fotiadis, G. A. Rovithakis, K. G. Vamvoudakis, “Embedding Learning-based Optimal Controllers with Assured Safety,” to appear in, IEEE Conference on Decision and Control, Milan, Italy, 2024. (invited paper)

[8] J. Netter, K. G. Vamvoudakis, T. Walsch, J. Ray, “Decision Boundary Estimation Using Reinforcement Learning for Complex Classification Problems,” to appear in, IEEE Conference on Decision and Control, Milan, Italy, 2024.

[9] N. Tukenmez, F. Fotiadis, J. M. Magalhães Júnior, K. G. Vamvoudakis, S. Bogosyan, “Reward Drops in Learning-based Control with an Experimental Validation on Microdrones,” to appear in, IEEE Conference on Decision and Control, Milan, Italy, 2024. (invited paper)

[10] S. Chakraborty, W. Gao, K. G. Vamvoudakis, Z.-P. Jiang, “Resilient Learning-based Control Under DoS Attacks,” to appear in, IEEE Conference on Decision and Control, Milan, Italy, 2024.

[11] A. Kanellopoulos, F. Fotiadis, K. G. Vamvoudakis, H. Sanberg, “Unpredictable Switching for Cyber-Physical Security Against Worst-case Attackers,” to appear in, IEEE Conference on Decision and Control, Milan, Italy, 2024. (invited paper)

[12] O. Qasem, W. Gao, K. G. Vamvoudakis, H. Gutierrez, “Adaptive Optimal Control of Continuous-Time Nonlinear Systems via Hybrid Iteration: An Adaptive Dynamic Programming Approach,” to appear in, IEEE Conference on Decision and Control, Milan, Italy, 2024.

[13] J. Netter, K. G. Vamvoudakis, “Adversarial Motion Planning using Gaussian Process Classification,” to appear in, IEEE Conference on Decision and Control, Milan, Italy, 2024. (invited paper)

[14] D. Staatz, K. G. Vamvoudakis, J. Netter, “Multi-Agent Motion Planning with Non-Uniform Sensors and Intermittent Q-Learning in Urban Air Mobility Scenarios,” to appear in, Modeling, Estimation, and Control Conference (MECC), 2024.

[15] S. Athalye, K. G. Vamvoudakis, “Adversarially Robust Pursuit-Evasion Games with Asymmetric and Incomplete Information,” to appear in, Modeling, Estimation, and Control Conference (MECC), 2024.

[16] N.-M. T. Kokolakis, K. G. Vamvoudakis, “Safe Predefined-Time Stability and Optimal Feedback Control: A Lyapunov-based Approach,” Proc. American Control Conference, pp. 3665-3670, Toronto, Canada, 2024.

[17] S. Athalye, F. Fotiadis, K. G. Vamvoudakis, J. Hugues, “An Output Feedback Game-Theoretic Approach for Defense against Stealthy GNSS Spoofing Attacks,” Proc. American Control Conference, pp. 3689-3694, Toronto, Canada, 2024.

[18] F. Fotiadis, A. Kanellopoulos, K. G. Vamvoudakis, J. Hugues, “Poisoning Actuation Attacks for the Learning of an Optimal Controller,” Proc. American Control Conference, pp. 4823-4828, Toronto, Canada, 2024.

[19] J. M. Magalhães Júnior, L. Zhai, F. Fotiadis, A. Kanellopoulos, K. G. Vamvoudakis, J. Hugues, “Real-Time and Experimental Reactive and Proactive Defense in a Multi-Agent Scenario,” Proc. AIAA SciTech Forum, Orlando, Florida, 2024. (invited paper)

[20] S. Chakraborty, W. Gao, K. G. Vamvoudakis, Z.-P. Jiang, “Adaptive Optimal Output Regulation of Discrete-Time Linear Systems: A Reinforcement Learning Approach,” Proc. IEEE Conference on Decision and Control, pp. 7944-7949, Marina Bay Sands, Singapore, 2023. (invited paper)

[21] F. Fotiadis, K. G. Vamvoudakis, “A Physics-Informed Neural Networks Framework to Solve the Infinite-Horizon Optimal Control Problem,” Proc. IEEE Conference on Decision and Control, pp. 6008-6013, Marina Bay Sands, Singapore, 2023. (invited paper)

[22] F. Fotiadis, K. G. Vamvoudakis, “Game-Theoretic Deception Methods for Perfectly and Bounded Rational Stealthy Attackers,” Proc. IEEE Conference on Decision and Control, pp. 7956-7963, Marina Bay Sands, Singapore, 2023. (invited paper)

[23] L. Zhai, K. G. Vamvoudakis, J. Hugues, “Safe Stochastic Model-based Policy Iteration with Chance Constraints,” Proc. IEEE Conference on Decision and Control, pp. 1808-1813, Marina Bay Sands, Singapore, 2023.

[24] M. I. Abouheaf, K. G. Vamvoudakis, H. A. Hashim, M. A. Mayyas, “An Observer-Based Reinforcement Learning Solution for Model-Following Problems,” Proc. IEEE Conference on Decision and Control, pp. 7970-7975, Marina Bay Sands, Singapore, 2023. (invited paper)

[25] C. Llanes, J. Netter, K. G. Vamvoudakis, S. Coogan, “Experimental Validation on Aerial Vehicles of Real-Time Motion Planning with Continuous-Time Q-Learning,” Proc. IFAC-PapersOnLine (Modeling, Estimation, and Control Conference (MECC)), vol. 56, no. 3, pp. 31-36, 2023.

[26] H. A. Hashim, A. E. E. Eltoukhy, K. G. Vamvoudakis, “Nonlinear Deterministic Observer for Inertial Navigation Using Ultra-Wideband and IMU Sensor Fusion,” Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3085-3090, Detroit, MI, 2023.

[27] N.-M. T. Kokolakis, K. G. Vamvoudakis, W. M. Haddad, “Fixed-Time Learning for Optimal Feedback Control,” Proc. ASME International Design Engineering Technical Conferences & Computers and Information in Engineering Conference (IDETC/CIE), Boston, MA, 2023.

[28] C. N. Mavridis, A. Kanellopoulos, K. G. Vamvoudakis, J. S. Baras, K. H. Johansson, “Attack Identification for Cyber-Physical Security in Dynamic Games under Cognitive Hierarchy,” Proc. IFAC World Congress, vol. 56, no. 2, pp. 11223-11228, Yokohama, Japan, 2023.

[29] N.-M. T. Kokolakis, K. G. Vamvoudakis, W. M. Haddad, “Reachability Analysis-based Safety-Critical Control using Online Fixed-Time Reinforcement Learning,” Proc. of The 5th Annual Learning for Dynamics and Control Conference, PMLR vol. 211, pp. 1257-1270, Philadelphia, PA, 2023.

[30] K. G. Vamvoudakis, F. Fotiadis, J. P. Hespanha, R. Chinchilla, G. Yang, M. Liu, J. S. Shamma, L. Pavel, “Game Theory for Autonomy: From Min-Max Optimization to Equilibrium and Bounded Rationality Learning,” Proc. American Control Conference, pp. 4363-4380, San Diego, CA, 2023. (invited 18 pages lead tutorial paper)

[31] L. Zhai, F. Fotiadis, K. G. Vamvoudakis, J. Hugues, “Timing-Aware Resilience of Data-driven Off-policy Reinforcement Learning for Discrete-Time Systems,” Proc. American Control Conference, pp. 2782-2787, San Diego, CA, 2023.

[32] J. Netter, K. G. Vamvoudakis, “Decentralized Multi-Agent Learning-based Motion Planning in Dynamic Environments,” Proc. American Control Conference, pp. 1655-1660, San Diego, CA, 2023.

[33] K. G. Vamvoudakis, “Non-Equilibrium Learning in Stochastic Games,” Proc. American Control Conference, pp. 4384, San Diego, CA, 2023.

[34] L. Zhai, A. Kanellopoulos, F. Fotiadis, K. G. Vamvoudakis, J. Hugues, “A Modular Approach to Verification of Learning Components in Cyber-Physical Systems,” Proc. AIAA SciTech, National Harbor, MD, 2023. (invited paper)

[35] J. M. Magalhães Júnior, G. L. O. Halila, K. G. Vamvoudakis, “Data-Driven Controller and Multi-Gradient Search Algorithm for Morphing Configurations,” Proc. AIAA SciTech, National Harbor, MD, 2023.

[36] T. Seo, P. P. Sahoo, K. G. Vamvoudakis, “Verification of Adversarially Robust Reinforcement Learning Mechanisms in Aerospace Systems,” Proc. AIAA SciTech, National Harbor, MD, 2023.

[37] F. Fotiadis, K. G. Vamvoudakis, Z.-P. Jiang, “Data-Based Actuator Selection for Optimal Control Allocation,” Proc. IEEE Conference on Decision and Control, pp. 4674-4679, Cancun, Mexico, 2022.

[38] N.-M. T. Kokolakis, K. G. Vamvoudakis, “Safe Finite-Time Reinforcement Learning for Pursuit-Evasion Games,” Proc. IEEE Conference on Decision and Control, pp. 4022-4027, Cancun, Mexico, 2022.

[39] T. Garg, S. Basu Roy, K. G. Vamvoudakis, “PI-like Estimator-based Adaptive Extremum Seeking Control using Initial Excitation,” Proc. IEEE Conference on Decision and Control, pp. 44-49, Cancun, Mexico, 2022.

[40] S. Bogosyan, M. Gokasan, K. G. Vamvoudakis, “Zero-Sum Game based Integral Reinforcement Learning for Trajectory Tracking Control of Autonomous Smart Car,” Proc. IEEE International Symposium on Industrial Electronics, pp. 1-4, Anchorage, AK, 2022.

[41] P. Sahoo, K. G. Vamvoudakis, “Intermittent Reinforcement Learning with Sparse Rewards,” Proc. American Control Conference, pp. 2709-2714, Atlanta, GA, 2022.

[42] F. Fotiadis, A. Kanellopoulos, K. G. Vamvoudakis, J. Hugues, “Impact of Sensor and Actuator Clock Offsets on Reinforcement Learning,” Proc. American Control Conference, pp. 2669-2674, Atlanta, GA, 2022.

[43] L. Zhai, K. G. Vamvoudakis, J. Hugues, “A Graph-theoretic Security Index Based on Undetectability for Cyber-Physical Systems,” Proc. American Control Conference, pp. 1479-1484, Atlanta, GA, 2022. (invited paper)

[44] N.-M. T. Kokolakis, K. G. Vamvoudakis, “Online Learning-based Optimal Control of Nonlinear Systems with Finite-Time Convergence Guarantees,” Proc. American Control Conference, pp. 812-817, Atlanta, GA, 2022. (invited paper)

[45] L. Zhai, A. Kanellopoulos, F. Fotiadis, K. G. Vamvoudakis, J. Hugues, “Towards Intelligent Security for Unmanned Aerial Vehicles: A Taxonomy of Attacks, Faults, and Detection Mechanisms,” Proc. AIAA SciTech Forum, 2022. (invited paper)

[46] F. Fotiadis, K. G. Vamvoudakis, “Learning-based Actuator Placement for Uncertain Systems,” Proc. IEEE Conference on Decision and Control, pp. 90-95, Austin, TX, 2021. (invited paper)

[47] F. Fotiadis, C. Verginis, K. G. Vamvoudakis, U. Topcu, “Assured Learning-based Optimal Control subject to Timed Temporal Logic Constraints,” Proc. IEEE Conference on Decision and Control, pp. 750-756, Austin, TX, 2021. (invited paper)

[48] A. Kanellopoulos, F. Fotiadis, C. Sun, Z. Xu, K. G. Vamvoudakis, U. Topcu, W. E. Dixon, “Temporal Logic-based Intermittent, Optimal, and Safe Continuous-Time Learning for Trajectory Tracking,” Proc. IEEE Conference on Decision and Control, pp. 1263-1268, Austin, TX, 2021. (invited paper)

[49] L. Zhai, K. G. Vamvoudakis, J. Hugues, “Switching Watermarking-based Detection Scheme Against Replay Attacks,” Proc. IEEE Conference on Decision and Control, pp. 4200-4205, Austin, TX, 2021.

[50] J. Netter, G. P. Kontoudis, K. G. Vamvoudakis, “Bounded Rational RRT-QX: Online Human-Like Motion Planning in Dynamic Environments using Cognitive Hierarchy and Q-Learning,” Proc. IEEE Conference on Decision and Control, pp. 3597-3602, Austin, TX, 2021.

[51] W. Kovalik, L. Zhai, K. G. Vamvoudakis, “Model-free Perception-based Control via Q-learning with an Application to a Heat-Seeking Missile,” Proc. IEEE Conference on Control Technology and Applications, pp. 1142-1147, San Diego, CA, 2021.

[52] A. Syed, T. Khamvilai, Y. Kim, K. G. Vamvoudakis, “Experimental Design and Control of a Smart Morphing Wing System using a Q-learning Framework,” Proc. IEEE Conference on Control Technology and Applications, pp. 354-359, San Diego, CA, 2021.

[53] A. Sequeira, A. Kanellopoulos, K. G. Vamvoudakis, “A Human-Integrated Tool for Proactive and Reactive Security in Cyber-Physical Systems,” Proc. IEEE Conference on Control Technology and Applications, pp. 899-904, San Diego, CA, 2021.

[54] L. Zhai, K. G. Vamvoudakis, “A Data-Based Moving Target Defense Framework for Switching Zero-Sum Games,” Proc. IEEE Conference on Control Technology and Applications, pp. 931-936, San Diego, CA, 2021.

[55] F. Fotiadis, K. G. Vamvoudakis, “Recursive Reasoning for Bounded Rationality in Multi-Agent Non-Equilibrium Play Learning Systems,” Proc. IEEE Conference on Control Technology and Applications, pp. 741-746, San Diego, CA, 2021.

[56] M. Sarkar, X. Yan, S. Nateghiboroujeni, B. J. Holmes, K. G. Vamvoudakis, A. Homaifar, “A Framework for Testing and Evaluation of Operational Performance of Multi-UAV Systems,” Proc. Intelligent Systems Conference (IntelliSys), pp. 355-374, Amsterdam, Netherlands, 2021.

[57] S. Kampezidou, J. Romberg, K. G. Vamvoudakis, D. Mavris, “Online Adaptive Learning in Energy Trading Stackelberg Games with Time-Coupling Constraints,” Proc. American Control Conference, pp. 717-722, New Orleans, LA, 2021. (invited paper)

[58] S. Shivam, Y. Wardi, M. Egerstedt, A. Kanellopoulos, K. G. Vamvoudakis, “Intersection-Traffic Control of Autonomous Vehicles using Newton-Raphson Flows and Barrier Functions,” Proc. IFAC World Congress, vol. 54, no. 2, pp. 15733-15738, Berlin, Germany, 2020.

[59] S. T. Krauss, D. J. Stilwell, M. L. Psiaki, K. G. Vamvoudakis, “Detection of a Drifting Acoustic Beacon from a Navigating AUV,” Proc. IEEE/MTS OCEANS, Singapore-U.S. Gulf Coast, 2020.

[60] A. Kanellopoulos, F. Fotiadis, K. G. Vamvoudakis, V. Gupta, “A Meta-Learning and Bounded Rationality Framework for Repeated Games in Adversarial Environments,” Proc. IEEE Conference on Decision and Control, pp. 1640-1645, Jeju Island, Republic of Korea, 2020.

[61] Y. Yang, H. Modares, K. G. Vamvoudakis, C.-Z. Xu, “Optimal Recursive Backstepping for Nonlinear Systems in a Strict-Feedback Form with Continuous and Intermittent Updates,” Proc. IEEE Conference on Decision and Control, pp. 6216-6221, Jeju Island, Republic of Korea, 2020. (invited paper)

[62] F. Fotiadis, A. Kanellopoulos, K. G. Vamvoudakis, “Constrained Differential Games for Secure Decision-Making against Stealthy Attacks,” Proc. American Control Conference, pp. 4658-4663, Denver, CO, 2020.

[63] N.-M. T. Kokolakis, A. Kanellopoulos, K. G. Vamvoudakis, “Bounded Rational Unmanned Aerial Vehicle Coordination for Adversarial Target Tracking,” Proc. American Control Conference, pp. 2508-2513, Denver, CO, 2020.

[64] G. P. Kontoudis, Z. Xu, K. G. Vamvoudakis, “Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning,” Proc. American Control Conference, pp. 3873-3878, Denver, CO, 2020.

[65] C. Sun, K. G. Vamvoudakis, “Continuous-Time Safe Learning with Temporal Logic Constraints in Adversarial Environments,” Proc. American Control Conference, pp. 4786-4791, Denver, CO, 2020.

[66] G. P. Kontoudis, M. Liarokapis, K. G. Vamvoudakis, “An Adaptive, Humanlike Robot Hand with Selective Interdigitation: Towards Robust Grasping and Dexterous, In-Hand Manipulation,” Proc. IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 251-258, Toronto, Canada, 2019.

[67] A. Kanellopoulos, K. G. Vamvoudakis, V. Gupta, “Decentralized Verification for Dissipativity of Cascade Interconnected Systems,” Proc. IEEE Conference on Decision and Control, pp. 3629-3634, Nice, France, 2019. (invited paper)

[68] S. Shivam, A. Kanellopoulos, K. G. Vamvoudakis, Y. Wardi, “A Predictive Deep Learning Approach to Output Regulation: The Case of Collaborative Pursuit Evasion,” Proc. IEEE Conference on Decision and Control, pp. 853-859, Nice, France, 2019.

[69] Y. Yang, K. G. Vamvoudakis, H. Modares, W. He, Y. Xin, D. Wunsch, “Safe Intermittent Reinforcement Learning for Nonlinear Systems,” Proc. IEEE Conference on Decision and Control, pp. 690-697, Nice, France, 2019. (invited paper)

[70] V. G. Lopez, K. G. Vamvoudakis, Y. Wan, F. L. Lewis, “Off-Policy Reinforcement-Learning Algorithm to Solve Minimax Games on Graphs,” Proc. IEEE Conference on Decision and Control, pp. 6473-6478, Nice, France, 2019. (invited paper)

[71] J. I. Poveda, K. G. Vamvoudakis, M. Benosman, “CODES: Cooperative Data-Enabled Extremum Seeking for Multi-Agent Systems,” Proc. IEEE Conference on Decision and Control, pp. 2988-2993, Nice, France, 2019.

[72] J. I. Poveda, K. G. Vamvoudakis, M. Benosman, “DEES: A Class of Data-Enabled Robust Feedback Algorithms for Real-Time Optimization,” Proc. 11th IFAC Symposium on Nonlinear Control Systems (NolCoS), vol. 52, no. 16, pp.670-675, Vienna, Austria, 2019. (invited paper)

[73] K. G. Vamvoudakis, A. Kanellopoulos, “Non-Equilibrium Learning and Cyber-Physical Security,” Proc. 57th Annual Allerton Conference on Communication, Control, and Computing, pp. 1-6, Monticello, IL, 2019. (invited paper)

[74] Y. Zhou, K. G. Vamvoudakis, W. M. Haddad, Z.-P. Jiang, “A Secure Control Learning Framework for Cyber-Physical Systems under Sensor Attacks,” Proc. American Control Conference, pp. 4280-4285, Philadelphia, PA, 2019.

[75] A. Kanellopoulos, K. G. Vamvoudakis, “Switching for Unpredictability: A Proactive Defense Control Approach,” Proc. American Control Conference, pp. 4338-4343, Philadelphia, PA, 2019.

[76] P. K. Gundu, K. G. Vamvoudakis, R. M. Gerdes, “An Intermittent Learning Algorithm for High-Speed Autonomous Driving in Unknown Environments,” Proc. American Control Conference, pp. 4286-4292, Philadelphia, PA, 2019.

[77] G. P. Kontoudis, K. G. Vamvoudakis, “Robust Kinodynamic Motion Planning using Model-Free Game-Theoretic Learning,” Proc. American Control Conference, pp. 273-278, Philadelphia, PA, 2019.

[78] Y. Yang, K. G. Vamvoudakis, H. Modares, W. He, Y. Xin, D. Wunsch, “Safety Aware Reinforcement Learning Framework with an Actor-Critic-Barrier Structure,” Proc. American Control Conference, pp. 2352-2358, Philadelphia, PA, 2019. (invited paper)

[79] G. P. Kontoudis, M. Liarokapis, K. G. Vamvoudakis, “Underactuated Finger for Anthropomorphic Hands,” Proc. IEEE-RAS-EMBS International Conference on Rehabilitation Robotics (ICORR), pp. 682-688, Toronto, Canada, 2019.

[80] A. Kanellopoulos, K. G. Vamvoudakis, Y. Wardi, “Predictive Learning via Lookahead Simulation,” Proc. AIAA SciTech Forum, 2019. (invited paper)

[81] Y. Yang, K. G. Vamvoudakis, H. Ferraz, H. Modares, “Dynamic Intermittent Q-Learning for Systems with Reduced Bandwidth,” Proc. IEEE Conference on Decision and Control, pp. 924-931, Miami, FL, 2018. (invited paper)

[82] D. Muniraj, K. G. Vamvoudakis, M. Farhood, “Enforcing Signal Temporal Logic Specifications in Multi-Agent Adversarial Environments: A Deep Q-learning Approach,” Proc. IEEE Conference on Decision and Control, pp. 4141-4146, Miami, FL, 2018.

[83] X. Jin, W. M. Haddad, Z.-P. Jiang, K. G. Vamvoudakis, “Adaptive Control for Mitigating Sensor and Actuator Attacks in Connected Autonomous Vehicle Platoons,” Proc. IEEE Conference on Decision and Control, pp. 2810-2815, Miami, FL, 2018.

[84] M. Grammatopoulou, A. Kanellopoulos, K. G. Vamvoudakis, “A Multi-step and Resilient Predictive Q-learning Algorithm for IoT: A Case Study in Water Supply Networks,” Proc. International Conference on the Internet of Things (IoT), pp. 18:1-18:8, Santa Barbara, CA, 2018.

[85] A. Farahmandi, G. Hewer, B. Reitz, K. Estabridis, K. G. Vamvoudakis, “A Model Free Learning Algorithm to Control Autonomous Streams over IoT,” Proc. International Conference on the Internet of Things (IoT), pp. 33:1-33:4, Santa Barbara, CA, 2018.

[86] Y. Yang, K. G. Vamvoudakis, H. Modares, D. Ding, Y. X. Yin, D. Wunsch, “Dynamic Intermittent Suboptimal Control: Performance Quantification and Comparisons,” Proc. Chinese Control Conference, pp. 2017-2022, Wuhan, China, 2018.

[87] Y. Yang, H. Modares, K. G. Vamvoudakis, Y. X. Yin, D. Wunsch, “Model-Free Event-Triggered Containment Control of Multi-Agent Systems,” Proc. American Control Conference, pp. 877-884, Milwaukee, WI, 2018.

[88] K. D. Tsoukalas, G. P. Kontoudis, K. G. Vamvoudakis, “Active-Bayesian Learning for Cooperation Connectivity in Dynamic Cyber-Physical-Human Systems,” Proc. IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), Honolulu, HI, 2017. (invited paper)

[89] K. G. Vamvoudakis, F. R. Pour Safaei, “Stochastic Zero-Sum Nash Games for Uncertain Nonlinear Markovian Jump Systems,” Proc. 56th IEEE Conference on Decision and Control, pp. 5582-5589, Melbourne, Australia, 2017.

[90] J. I. Poveda, K. G. Vamvoudakis, M. Benosman, “A Neuro-Adaptive Architecture for Extremum Seeking Control using Hybrid Learning Dynamics,” Proc. American Control Conference, pp. 542-547, Seattle, WA, 2017.

[91] J. Na, G. Herrmann, K. G. Vamvoudakis, “Adaptive Optimal Observer Design via Approximate Dynamic Programming,” Proc. American Control Conference, pp. 3288-3293, Seattle, WA, 2017.

[92] F. Tatari, M. B. Naghibi-Sistani, K. G. Vamvoudakis, “Distributed Optimal Synchronization Control of Linear Networked Systems under Unknown Dynamics,” Proc. American Control Conference, pp. 668-673, Seattle, WA, 2017.

[93] B. Kiumarsi, K. G. Vamvoudakis, H. Modares, F. L. Lewis, “Advances in Reinforcement Learning Structures for Continuous-Time Dynamical Systems,” Proc. 18th Yale Workshop on Adaptive and Learning Systems, Yale University, 2017. (invited paper)

[94] K. G. Vamvoudakis, H. Ferraz, “Event-Triggered H-infinity Control for Unknown Continuous-Time Systems using Q-learning,” Proc. 55th IEEE Conference on Decision and Control, pp. 1376-1381, Las Vegas, NV, 2016.

[95] K. G. Vamvoudakis, “Game-Theoretic Tracking Control for Actuator Attack Attenuation in Cyber-Physical Systems,” Proc. International Joint Conference on Neural Networks (IJCNN), pp. 4233-4240, Vancouver, Canada, 2016. (invited paper)

[96] K. G. Vamvoudakis, “Optimal Trajectory Output Tracking Control with a Q-learning Algorithm,” Proc. American Control Conference, pp. 5752-5757, Boston, MA, 2016.

[97] M. F. Miranda, K. G. Vamvoudakis, “Online Optimal Auto-Tuning of PID Controllers for a Special Class of Linear Systems,” Proc. American Control Conference, pp. 5443-5448, Boston, MA, 2016.

[98] K. G. Vamvoudakis, P. J. Antsaklis, W. E. Dixon, J. P. Hespanha, F. L. Lewis, H. Modares, B. Kiumarsi, “Autonomy and Machine Intelligence in Complex Systems: A Tutorial,” Proc. American Control Conference, pp. 5062-5079, Chicago, IL, 2015. (invited 18 pages lead tutorial paper)

[99] K. G. Vamvoudakis, J. P. Hespanha, “Model-Free Plug-n-Play Optimization Techniques to Design Autonomous and Resilient Complex Systems,” Proc. American Control Conference, pp. 5081, Chicago, IL, 2015.

[100] Q. Jiao, H. Modares, S. Xu, F. L. Lewis, K. G. Vamvoudakis, “Disturbance Rejection of Multi-Agent Systems: A Reinforcement Learning Differential Game Approach,” Proc. American Control Conference, pp. 737-742, Chicago, IL, 2015.

[101] K. G. Vamvoudakis, J. P. Hespanha, “Online Optimal Switching of Single Phase DC/AC Inverters using Partial Information,” Proc. American Control Conference, pp. 2624-2630, Portland, OR, 2014.

[102] K. G. Vamvoudakis, “An Online Actor/Critic Algorithm for Event-Triggered Optimal Control of Continuous-Time Nonlinear Systems,” Proc. American Control Conference, pp. 1-6, Portland, OR, 2014.

[103] K. G. Vamvoudakis, “Distributed Games for Multi-Agent Systems,” Proc. Agile Ground Vehicle Dynamics, Energy Efficiency, and Performance in Severe Environments: International Engineering Symposium, Birmingham, AL, 2013. (keynote invited speaker paper)

[104] M. I. Abouheaf, F. L. Lewis, S. Haesaert, R. Babuska, K. G. Vamvoudakis, “Multi-Agent Discrete-Time Graphical Games: Interactive Nash Equilibrium and Value Iteration Solution,” Proc. American Control Conference, pp. 4195-4201, Washington, DC, 2013.

[105] K. G. Vamvoudakis, L. R. Garcia Carrillo, J. P. Hespanha, “Learning Consensus in Adversarial Environments,” Proc. SPIE Defense, Security and Sensing, Baltimore, MD, 2013. (invited paper)

[106] K. G. Vamvoudakis, J. P. Hespanha, R. A. Kemmerer, G. Vigna, “Formulating Cyber-Security as Convex Optimization Problems,” Proc. Workshop on Control of Cyber-Physical Systems, Johns Hopkins University, 2013.

[107] K. G. Vamvoudakis, J. P. Hespanha, B. Sinopoli, Y. Mo, “Adversarial Detection as a Zero-Sum Game,” Proc. 51st IEEE Conference on Decision and Control, pp. 7133-7138, Maui, HI, 2012. (invited paper)

[108] K. G. Vamvoudakis, F. L. Lewis, M. Johnson, W. E. Dixon, “Online Learning Algorithm for Stackelberg Games in Problems with Hierarchy,” Proc. 51st IEEE Conference on Decision and Control, pp. 1883-1889, Maui, HI, 2012. (invited paper)

[109] K. G. Vamvoudakis, F. L. Lewis, “An Online Integral Reinforcement Learning Algorithm to Solve N-Player Nash Games,” Proc. IEEE Multi-Conference on Systems and Control, pp. 697-702, Dubrovnik, Croatia, 2012.

[110] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Adaptive Optimal Control Algorithm for Zero-Sum Nash Games with Integral Reinforcement Learning,” Proc. AIAA Guidance, Navigation, and Control Conference, Minneapolis, MN, 2012. (invited paper)

[111] K. G. Vamvoudakis, F. L. Lewis, “Policy Iteration Algorithm for Distributed Networks and Graphical Games,” Proc. 50th IEEE Conference on Decision and Control, pp. 128-135, Orlando, FL, 2011. (invited paper)

[112] K. G. Vamvoudakis, F. L. Lewis, “Non-Zero Sum Games: Online Learning Solution of Coupled Hamilton-Jacobi and Coupled Riccati Equations,” Proc. IEEE Multi-Conference on Systems and Control, pp. 171-178, Denver, CO, 2011. (invited paper)

[113] K. G. Vamvoudakis, F. L. Lewis, “Multi-Agent Differential Graphical Games,” Proc. 30th Chinese Control Conference, pp. 4932–4939, China, 2011.

[114] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Online Learning of Optimal Control Solutions using Integral Reinforcement Learning and Neural Networks,” Proc. 15th Yale Workshop on Adaptive and Learning Systems, Yale University, 2011. (invited paper)

[115] K. G. Vamvoudakis, D.Vrabie, F. L. Lewis, “Online Adaptive Learning of Optimal Control Solutions using Integral Reinforcement Learning,” Proc. IEEE Symp. Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), pp. 250-257, France, 2011. (invited paper)

[116] K. G. Vamvoudakis, M. A. Christodoulou, “Adaptive Backstepping Neural Network Control for Mechanical Pumps,” Proc. 4th Chaotic Modeling and Simulation International Conference (CHAOS), pp. 589-602, Crete, Greece, 2011.

[117] K. G. Vamvoudakis, M. A. Christodoulou, “Adaptive Control of Mixed-Interlaced forms,” Proc. 4th Chaotic Modeling and Simulation International Conference (CHAOS), pp. 603-616, Crete, Greece, 2011.

[118] K. G. Vamvoudakis, F. L. Lewis, “Online Solution of Nonlinear Two-Player Zero-Sum Games using Synchronous Policy Iteration,” Proc. 49th IEEE Conference on Decision and Control, pp. 3040-3047, Atlanta, GA, 2010. (invited paper)

[119] K. G. Vamvoudakis, D. G. Mikulski, G. R. Hudas, F. L. Lewis, E. Y. Gu, “Distributed Games for Multi-Agent Systems: Games on Communication Graphs,” Proc. 27th Army Science Conference, Orlando, FL, 2010. (This paper won the best paper award.)

[120] G. Hudas, F. L. Lewis, K. G. Vamvoudakis, “Online Gaming for Learning Optimal Team Strategies in Real Time,” Proc. SPIE Defense, Security and Sensing, vol. 7692, 76920W, 2010. (invited paper)

[121] F. L. Lewis, K. G. Vamvoudakis, “Optimal Adaptive Control for Unknown Systems using Output Feedback by Reinforcement Learning Methods,” Proc. 8th IEEE International Conference on Control & Automation, pp. 2138 - 2145, Xiamen, China, 2010.

[122] K. G. Vamvoudakis, D.Vrabie, F. L. Lewis, “Online Policy Iteration Based Algorithms to Solve the Continuous-Time Infinite Horizon Optimal Control Problem,” Proc. IEEE Symp. Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), pp. 36-41, Nashville, TN, 2009.

[123] K. G. Vamvoudakis,  F. L. Lewis, “Online Actor Critic Algorithm to Solve the Continuous-Time Infinite Horizon Optimal Control Problem,” Proc. International Joint Conference on Neural Networks (IJCNN), pp. 3180-3187, Atlanta, GA, 2009. (invited paper and the most cited paper in IJCNN, Arnetminer, 2009-present)

[124] D.Vrabie, K. G. Vamvoudakis, F. L. Lewis, “Adaptive Optimal Controllers Based on Generalized policy iteration in a Continuous-Time Framework,” Proc. IEEE Mediterranean Conference on Control and Automation, pp. 1402-1409, Thessaloniki, Greece, 2009. (invited paper)

[125] K. G. Vamvoudakis, M. A. Christodoulou, “Adaptive Backstepping Control for MAPK Cascade Models using RBF Neural Networks,” Proc. IEEE Mediterranean Conference on Control and Automation, Athens, Greece, 2007.

[126] K. G. Vamvoudakis, M. A. Christodoulou, “Backstepping, Interlaced and Mixed Interlaced Adaptive Nonlinear Control for Biological Models,” Proc. Intelligent Systems and Computing: Theory and Applications Conference (ISYC 06), pp. 196-219, Ayia Napa, Cyprus, 2006.

Other

[1] P. Zhou, X. Dai, K. G. Vamvoudakis, J. Faigl, H. Wang, “Guest Editorial Special Issue on Learning from Imperfect Data for Industrial Automation,” IEEE Transactions on Automation Science and Engineering, vol. 21, no. 2, pp. 1088-1091, 2024.

[2] W. Gao, N. Li, K. G. Vamvoudakis, F. Richard Yu, Z.-P. Jiang, “Guest Editorial Special Issue on Reinforcement Learning Based Control: Data-Efficient and Resilient Methods,” IEEE Transactions on Neural Networks and Learning Systems, vol. 35, no. 3, pp. 3103-3106, 2024.

[3] K. G. Vamvoudakis, “A Dynamical Systems Theory of Thermodynamics by Wassim M. Haddad,” IEEE Control Systems Magazine, vol. 42, no. 2, pp. 131-132, 2022.

[4] Y. Wan, E. Atkins, D. Sun, K. G. Vamvoudakis, K. Goulias, “Guest Editorial Introduction to the Special Issue of Unmanned Aircraft System Traffic Management,” IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 9, pp. 5874-5879, 2021.

[5] T. Yang, J. Ding, K. G. Vamvoudakis, S. J. Qin, “Guest Editorial Introduction to the Special Issue of Industrial Artificial Intelligence for Smart Manufacturing,” IEEE Transactions on Industrial Informatics, vol. 17, no. 12, pp. 8319-8323, 2021.

[6] G. Cherubini, M. Guay, S. Tarbouriech, K. Ariyur, M. E. Broucke, S. Dey, C. Ebenbauer, P. Frasca, B. Gharesifard, A. Girard, J. M. Gomes da Silva, L. Grune, C. M. Kellett, U. Khan, G. Notarstefano, L. Scardovi, K. G. Vamvoudakis, “Guest Editorial Introduction to the Special Issue of the IEEE L-CSS on Learning and Control,” IEEE Control Systems Letters, vol. 4, no. 3, pp. 710-712, 2020.

[7] K. G. Vamvoudakis, Y. Wan, F. L. Lewis, “Chairs Report on the Workshop: Distributed Reinforcement Learning and Reinforcement-Learning Games,” IEEE Control Systems Magazine, vol. 39, no. 6, pp. 122-124, December 2019.

[8] K. G. Vamvoudakis, “People in Control,” IEEE Control Systems Magazine, vol. 39, no. 5, pp. 31-33, October 2019.

[9] K. G. Vamvoudakis, S. Jagannathan, “Chairs Report on the Workshop: Recent Advances and Future Directions on Adaptation and Control,” IEEE Control Systems Magazine, vol. 36, no. 2, pp. 128-130, 2016.

[10] K. G. Vamvoudakis, “Optimal and Robust Scheduling for Networked Control Systems by Stefano Longo, Tingli Su, Guido Herrmann, and Phil Barber,” IEEE Control Systems Magazine, vol. 35, no. 2, pp. 101-103, 2015.

Proceedings and Reprint Volumes

[1] K. Janowicz, W. Kuhn, F. Cena, A. Haller, K. G. Vamvoudakis, “Proc. of the 8th International Conference on the Internet of Things (IoT),” Santa Barbara, California, Association for Computing Machinery (ACM), 2018.

Tutorials and Workshops

[1] K. G. Vamvoudakis, M. Liu, “Tutorial on Game Theory for Autonomy: From Min-Max Optimization to Equilibrium and Bounded Rationality Learning,” American Control Conference, San Diego, CA, 2023. (invited speakers also include: J. Shamma, L. Pavel, J. P. Hespanha)

[2] K. G. Vamvoudakis, “Recent Developments on Autonomy and Security of Cyber-Physical Systems,” NSF CPS PI Meeting, Alexandria, VA, 2018. (invited speakers also include: J. P. Hespanha, G. J. Pappas, P. Tabuada, R. Gerdes, F. Pasqualetti, Y. Wan)

[3] K. G. Vamvoudakis, J. P. Hespanha, “Tutorial on Autonomy and Machine Intelligence in Complex Systems,” American Control Conference, Chicago, IL, 2015. (invited speakers also include: P. J. Antsaklis, W. E. Dixon, J. P. Hespanha, F. L. Lewis, K. G. Vamvoudakis)

[4] K. G. Vamvoudakis, S. Jagannathan, “Workshop on Recent Advances and Future Directions on Adaptation and Control,” Chicago, IL, 2015.

[5] F. L. Lewis, K. G. Vamvoudakis, D. Vrabie, “Optimal Control and Online Game Solutions using Approximate Dynamic Programming,” 50th IEEE Conference on Decision and Control (Workshop on Optimal Adaptive Control: Online Solutions for Optimal Feedback Control and Differential Games using Reinforcement Learning), Orlando, FL, 2011.

[6] F. L. Lewis, K. G. Vamvoudakis, D. Vrabie, “ADP for Control of Continuous-Time Dynamical Systems, Multi-Player Differential Games, and Games on Graphs,” IEEE Symposium Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), Paris, France, 2011.

Posters

[1] K. G. Vamvoudakis, “Constrained Differential Games for Secure Decision-Making against Stealthy Attacks,” 8th Arab-American Frontiers of Science, Engineering, and Medicine Symposium, Bin Khalifa University, Qatar, November 2021.

[2] K. G. Vamvoudakis, “Model-Free Online Optimal Adaptive Control and Non-Zero Sum Games with Applications to Network Security,” USC Workshop on Future Directions in Networks, Optimization & Controls, Los Angeles, CA, December 2014.

Technical Reports

[1] N. Stockman, K. G. Vamvoudakis, L. Devendorf, T. Höllerer, R. Kemmerer, J. P. Hespanha, “A Mission-Centric Visualization Tool for Cybersecurity Situation Awareness,” University of California, Santa Barbara, August 2012.

[2] K. G. Vamvoudakis, J. P. Hespanha, “Optimal Attacks for the iCTF Game,” University of California, Santa Barbara, July 2012.

Theses

[1] PhD Thesis: F. Fotiadis, “Game-Theoretic Learning and Control for Resilience of Complex Adaptive Systems,” Georgia Tech, Atlanta, GA, July 2024.

[2] PhD Thesis: N.-M. T. Kokolakis, “Fixed-Time Reinforcement Learning-based Control for Safe Autonomy,” Georgia Tech, Atlanta, GA, July 2024.

[3] PhD Thesis: J. M. Magalhães Júnior, “Intelligent Data-driven Aerodynamic Analysis and Optimization of Morphing Configurations,” Georgia Tech, Atlanta, GA, December 2023.

[4] PhD Thesis: P. P. Sahoo, “Secure, Intermittent, and Model-Free Autonomous Framework for Cyber Physical Systems,” Georgia Tech, Atlanta, GA, December 2023.

[5] PhD Thesis: L. Zhai, “Architectures for Hardening Security in Intelligent Cyber-Physical Systems,” Georgia Tech, Atlanta, GA, May 2023.

[6] PhD Thesis: H. Zhu, “A Systems Engineering Approach to the Design and Education of a Robotic Baby,” Georgia Tech, Atlanta, GA, December 2022.

[7] PhD Thesis: K. P. M. Garanger, “Versatile and Structurally Efficient Aerial Systems Assembled from Polyhedral Rotorcraft Modules,” Georgia Tech, Atlanta, GA, April 2022.

[8] PhD Thesis: A. Kanellopoulos, “Control and Game-Theoretic Methods for Secure Cyber-Physical-Human Systems,” Georgia Tech, Atlanta, GA, December 2021.

[9] PhD Thesis: T. Khamvilai, “Optimization-based Design of Fault-Tolerant Avionics,” Georgia Tech, Atlanta, GA, December 2021.

[10] Master Thesis: C. Costopoulos, “Rechability Analysis Optimal Control,” National Technical University of Athens, Greece, September 2023.

[11] Master Thesis: T. Seo, “Verification of Adversarially Robust Reinforcement Learning Mechanisms in Autonomous Systems,” Georgia Tech, Atlanta, GA, December 2022.

[12] Master Thesis: D. Staatz, “Model-Free Multi-Agent Motion Planning with Non-Uniform Sensors,” Georgia Tech, Atlanta, GA, April 2022.

[13] Master Thesis: P. K. Gundu, “Trajectory Tracking Control of Unmanned Ground Vehicles using an Intermittent Learning Algorithm,” Virginia Tech, Blacksburg, VA, July 2019.

[14] Master Thesis: G. P. Kontoudis, “Adaptive, Anthropomorphic Robot Hands for Grasping and In-Hand Manipulation,” Virginia Tech, Blacksburg, VA, December 2018.

[15] PhD Thesis: K. G. Vamvoudakis, “Online Learning Algorithms for Differential Dynamic Games and Optimal Control,” University of Texas at Arlington, May 2011.

[16] Diploma Thesis: K. G. Vamvoudakis, “Adaptive Control for MAPK Cascade Models using RBF Neural Networks,” Technical University of Crete, June 2006.

My Erdös number

An upper bound on my Erdös number is 3 (one of the paths is given below).