Kyriakos G. Vamvoudakis - Research Projects
Our research draws from the areas of control theory, game theory and computational intelligence. Our recent research interests lie in the design of robust and secure multi-agent networked systems, such as smart grids, and unmanned aerial and ground vehicles. Below is a brief description of some recent research projects.
Aerodynamic Intelligent Morphing System (A-IMS) for Autonomous Smart Utility Truck Safety and Productivity in Severe Environments
Funding Source: NSF S&AS-1849198,
Utility trucks are the first responders in areas of extreme climate and severe weather situations for recovering life beings from destroyed properties, for cutting trees to restore traffic, and for repairing electric posts and restoring power. It is thus crucial to create an advanced and effective scientific framework for maintaining productivity and safety while simultaneously eliminating accidents. Towards that direction, this project aims to establish a novel and integrated framework to monitor and predict weather conditions and feed such information into reinforcement learning mechanisms that will enable us to autonomously shape the utility trucks.
Unlike conventional approaches, the A-IMS will integrate model-free shape-morphing learning mechanisms with model-based interactive design to manage air-fluid flows, based on the road conditions, meteorology, speed limit, wind speed, and direction. This potentially transformative framework for A-IMS will: (1) bring new perspectives of learning to enhance smartness of natural-engineering systems that leverage physical and information processes; (2) establish an integrated design framework for hazardous environments to achieve resilience, and productivity through integrated adaptation of morphological properties while also mitigating the effects of potentially adversarial learning agents that can exist in the cloud; (3) investigate the interactive physical components of the A-IMS, that will simultaneously operate in two different mediums of multi-phase fluids, and solids (i.e., the air/fluid and road). The A-IMS framework shall be evaluated through, (i) hardware/software implementation, and in (ii) real-world conditions in the unique facilities of the Wall of Wind at the Florida International University.
For more details see our published work.
Non-Equilibrium Game-Theoretic Learning Techniques For Mitigating Adversaries in Complex Adaptive Systems (CAS)
Funding Source: ARO YIP
The networks and information systems that are being constructed today are extremely complex. A cyberphysical
attack against a network could have cascading and devastating effects on other portions of the information
enterprise. To defend against a network wide attack, it is imperative that we know what is on our
systems and their composition. We need to know what computers we have, what applications are running,
what vulnerabilities exist and what networks are related to other networks. Only when armed with this type of
information can we possibly adapt our countermeasures and protection procedures to counter an attack.
The objective of this project is to develop novel learning frameworks for non-equilibrium game-theoretic adaptive
algorithms for systems in adversarial, dynamic and uncertain environments. The technical approach is
to be inspired by interdisciplinary ideas from different fields, such as game theory, nonlinear adaptive learning
theory, cognitive science and network security. The anticipated outcomes include the development of
(i) level-k learning architectures for security, where decision makers are not perfectly rational and do not possess infinite
intelligence; (ii) a learning-based moving target defense that reduces predictability; and (iii) a resilient learning
framework to bandwidth depletion attacks. The contributions and impact on Army's objectives will be
the ability to multiply engagement capability, and enable coordination of distributed, heterogeneous teams of
manned, unmanned vehicles and humans in dynamic, adversarial and completely uncertain environments. The
models, theories, techniques, and tools developed as part of the proposed research will lay the foundation for
the DoD to develop more effective techniques against intelligent attackers with different levels of rationality and
For more details see our published work.
Intermittent Learning Framework for Smart and Efficient Cyber-Physical Autonomy
Funding Source: NSF CAREER CPS-1851588, NSF CAREER CPS-1750789,
Current learning algorithms cannot be easily applied in CPS due to their need for
continuous and expensive updates, with the current triggered frameworks having fundamental limitations.
Such limitations lead to the following questions. How can we incorporate and fully adapt to totally
unknown, dynamic, and uncertain environments? How do we co-design the action and the intermittent
schemes? How can we provide quantifiable real-time performance, stability and robustness guarantees by
design? And how do we solve congestion and guarantee security? We will build on our multiyear experience
and develop fundamental contributions to CPS by providing novel frameworks that will allow thensf
fully autonomous operation in the face of unknown, bandwidth restricted, and adversarial environments.
As specific merits, the project will, (i) unify new perspectives of learning in engineering to enable smart
autonomy, resiliency, bandwidth efficiency, robustness, real-time optimality and adaptation that cannot
be achieved with the state-of-the-art approaches; (ii) develop intermittent deep learning methods for CPS
that can mitigate sensor attacks by dynamically isolating the suspicious components and can handle cases
of limited sensing capabilities; (iii) incorporate nonequilibrium game-theoretic learning in CPS with
components that do not share similar mechanisms for decision making and do not have the same level
of rationality due to heterogeneity and may differ in either their information obtained or their ability in
utilizing it; and (iv) investigate ways to transfer intermittent learning experiences among the agents.
For more details see the project's webpage and our published work.
Data-Driven Learning Techniques for Cyber-Physical-Situation Awareness in Defense Systems
Funding Source: ONR Minerva Research Initiative
The objective of this project is to investigate and develop novel data-driven learning techniques for realtime
and adaptive cyber-physical situation awareness of adversarial activities, and feed information about
the impact of those activities back to the security analysts. This will significantly enhance awareness and
safety in defense systems by providing fast decision making along with, guarantees for mission completion
and conditions for robustness. The guaranteed robustness of the proposed data-driven learning techniques
will ensure fast prompt and/or automated decision making without reaching back to higher command levels.
The technical approach is to be inspired by interdisciplinary ideas from different fields, such as game theory,
cognitive learning (specifically reinforcement learning), cyber-physical systems, and network security.
The anticipated outcomes include transformative data-driven learning algorithms to engage the DoD security
analysts in the characterization, recognition and mitigation of adversarial actions, with the support of
rapid decision-making through prompt action, and recommendations/actions from "automated assistants." For more details see our published work.
Enforcement of Geofencing Policies for Commercial Unmanned Aircraft Systems
Funding Source: NSF SATC-1801611
Collaborators: R. Gerdes, M. Farhood, J. M. Park (Virginia Tech), M. Li (University of Arizona)
The adoption of services and applications that rely on Unmanned Aircraft Systems (UAS) is expected to continue its acceleration for the foreseeable future. Such services and applications include search and rescue, crop monitoring, real-time traffic monitoring, critical infrastructure inspections, and others. As UAS continue to proliferate, aviation regulatory agencies around the world are facing a challenging dilemma in terms of safely integrating UAS operations into their respective national airspace systems and enforcing their compliance to relevant regulations, including enforcement of no fly-zones. Current UAS lack effective on-board flight restrictions that would prevent them from entering critical airspace, e.g., airport runways and nuclear power plants. Furthermore, it is essential that the safety and privacy of members of the public be safeguarded from accidental and non-accidental UAS incursions. This project aims to address these critical needs by developing offensive and defensive measures for detecting, identifying, and bringing down UAS that violate controlled/restricted airspace in an automated, controlled, and reliable manner.
A three phase approach to thwarting a UAS encroaching on restricted airspace will be used: (1) detect the incursion using passive radar that exploits signals of opportunity and radio frequency (RF) communications/emissions from the encroacher itself; (2) deploy one or more defender UAS, capable of learning the motivations and behaviors of the encroacher, to pursue the UAS and gain and maintain proximity to it even should the encroacher take evasive action; and (3) have the defender UAS launch offensive measures that manipulate/compromise the sensor and actuation signals the encroacher relies on to stay airborne. For more details see our published work.
Enabling Secure and Resilient Extremely Fast Charging: A Software/Hardware-Security Co-Design Approach
Funding Source: Department of Energy
Collaborators: Ryan Gerdes (PI) and several others from Virginia Tech, Utah State, OnBoard Security, ChargePoint Inc., Ford Motor Co., and Commonwealth Edison Company
Extremely fast charging (XFC) has the potential to reduce the charging time of battery electric vehicles (BEV)
to be equivalent to the filling time of internal combustion engine vehicles (ICEV), thus eliminating one of the
few advantages ICEV still posses for light- and heavy-duty vehicles. Enabling XFC will, however, require
coordination and cooperation between the grid, charging stations, and the vehicles themselves, which leads
to an inevitable increase in the attack surface for all systems combined.
In securing the overall system,
we must not only embrace traditional cybersecurity, which is chiefly concerned with communications and
the operation of digital systems, but also cyber-physical systems security as the proper operation of XFC is
critically dependent on systems' abilities to know about (sense) and interact with (actuate) the physical world. For more details see our published work.
Mobility in Severe Terrain Environments
Funding Source: NATO SPS G5176
Collaborators: V. Vantsevich (University of Alabama)
The proposed project's effort is to develop and demonstrate a new technology to radically enhance vehicle tactical and operational mobility and survivability by establishing agile and interactive dynamics of innovative vehicle sub-systems. The scope of the proposed project is fundamental and is based on applied research in the multi-disciplinary mechatronics areas including ground vehicle engineering, sensor design and application, electronics and controls.
The new technology will enable vehicles of any weight class, with any number of wheels, independently driven wheels, or through a drive-train a unique ability to maintain mobility through high-speed and rapid maneuvers in complex off-road environments. Ramifications from this technology will greatly increase crew safety, reduce roll-overs, and enables vehicles too rapidly and aggressively veer/steer or experience external blast/force in on-road, off-road, and poor terrain conditions while maintaining vehicle control and mobility. The proposed system is a vehicle by-wire sub-system that controls and monitors the vehicle's mobility based on input programs of the motions via any autonomous controller or human operator input. For more details see our published work.
Security of Underwater Cyber-Physical Systems
Funding Source: NAVSEA
Collaborators: D. Stilwell, M. Psiaki (Virginia Tech)
The convergence of systems on modern UUVs and the reliance of the industry on connectivity leads
to a broad space for exploitable vulnerabilities. Unfortunately, due to current re-certification practices,
software and/or hardware fixes to address such vulnerabilities could take months to appear. The goal of
the proposed research is to increase the security of underwater cyber-physical systems (UCPS), which
include the UUVs themselves and necessary supporting infrastructure, through reductions in attack
surface, decreased time to patch, and increased resiliency to attacks, thus ensuring safety, integrity,
The overall objectives of this project are to assess cybersecurity risks for UUVs
and to propose practical countermeasures. For more details see our published work.
Reinforcement Learning for Optimal Adaptive Feedback Control and Games
Collaborators: F. L. Lewis (U. Texas), J. P. Hespanha (UCSB), W. Dixon (U. Florida), G. R. Hudas (US Army TARDEC), R. Babuska (TU Delft), D. Vrabie (PNNL), R. Kamalapurkar (Oklahoma State U.), S. Bhasin (IITD)
Adaptive control and optimal control represent different philosophies for
designing feedback control systems. These methods have been developed by the
Control Systems Community of engineers. Optimal controllers minimize user prescribed
performance functions and are normally designed offline by solving
Hamilton-Jacobi (HJ) design equations, for example, the Riccati equation,
using complete knowledge of the system dynamical model. However, it is often
difficult to determine an accurate dynamical model of practical systems.
We propose new techniques based on approximate dynamic programming that allow the design of adaptive
control systems with novel structures that learn the solutions to optimal control problems and Nash/Stackelberg games
in real time by observing data along the system trajectories. Complicated Lyapunov stability proofs ensure boundedness of the closed-loop signals. For more details see our published work.