Kyriakos G. Vamvoudakis - Research Projects

Our research draws from the areas of control theory, game theory and computational intelligence. Our recent research interests lie in the design of robust and secure multi-agent networked systems, such as smart grids, and unmanned aerial and ground vehicles. Below is a brief description of some recent research projects.

Secure and Safe Assured Autonomy

Funding Source: NASA ULI

Collaborators: Abdollah Homaifar (PI), and several others from NCAT, Purdue, Aurora Flight Sciences, Alakai Technologies Corporation, General Atomics Aeronautical Systems, Northrop Grumman Corporation

 

The last few decades have witnessed uninterrupted growth in "traditional" commercial aviation, creating modernization requirements for the National Airspace System (NAS) to meet increasing needs for capacity with safety through such initiatives as NextGen. The recent introduction of unmanned systems into the NAS will bring further challenges and opportunities for the nation's aviation system. The integration of such a complex transportation system creates a clear need to develop new technologies and innovative operational concepts for secure and safe assured autonomy. An unmanned systems future will see the integration of a wide variety of Unmanned Aerial Systems (UAS), personal air vehicles, Urban Air Mobility (UAM) vehicles, and cargo and special mission aircraft into the NAS. These developments can leverage UAS Traffic Management (UTM) advancements for the unique requirements of UAM airspace management.

This vision must include robust human-machine decision-making systems for increasingly autonomous traffic management. These unmanned systems and the associated decision-making infrastructure systems must handle atmospheric, traffic, and airspace uncertainties and must operate securely and safely at different levels of system complexity. Adopting this vision will provide greater diversity and richness for the NAS; however, critical technical challenges must be addressed to ensure secure and safe cyber-physical aviation systems. The main challenges include: (i) sensing and understanding complex operational surroundings, coordinating different types of aerial vehicles, planning and navigation through highly dynamic and uncertain environments; (ii) securing the NAS against a wide range of malicious adversarial threats, specifically cyber-physical attacks; (iii) verifying and validating autonomous system operation; and, finally, (iv) properly integrating new vehicles and traffic management approaches in the midst of autonomy. Our primary goal is to ensure safe, secure and robust integration of autonomous vehicles into a UAM-tailored transportation infrastructure while maintaining compliance with existing commercial and civil air transportation safety standards. For more details see our published work.

Aerodynamic Intelligent Morphing System (A-IMS) for Autonomous Smart Utility Truck Safety and Productivity in Severe Environments

Funding Source: NSF S&AS-1849198, NSF S&AS-1849264

 

Utility trucks are the first responders in areas of extreme climate and severe weather situations for recovering life beings from destroyed properties, for cutting trees to restore traffic, and for repairing electric posts and restoring power. It is thus crucial to create an advanced and effective scientific framework for maintaining productivity and safety while simultaneously eliminating accidents. Towards that direction, this project aims to establish a novel and integrated framework to monitor and predict weather conditions and feed such information into reinforcement learning mechanisms that will enable us to autonomously shape the utility trucks.

Unlike conventional approaches, the A-IMS will integrate model-free shape-morphing learning mechanisms with model-based interactive design to manage air-fluid flows, based on the road conditions, meteorology, speed limit, wind speed, and direction. This potentially transformative framework for A-IMS will: (1) bring new perspectives of learning to enhance smartness of natural-engineering systems that leverage physical and information processes; (2) establish an integrated design framework for hazardous environments to achieve resilience, and productivity through integrated adaptation of morphological properties while also mitigating the effects of potentially adversarial learning agents that can exist in the cloud; (3) investigate the interactive physical components of the A-IMS, that will simultaneously operate in two different mediums of multi-phase fluids, and solids (i.e., the air/fluid and road). The A-IMS framework shall be evaluated through, (i) hardware/software implementation, and in (ii) real-world conditions in the unique facilities of the Wall of Wind at the Florida International University. For more details see our published work.

Non-Equilibrium Game-Theoretic Learning Techniques For Mitigating Adversaries in Complex Adaptive Systems (CAS)

Funding Source: ARO YIP

 

The networks and information systems that are being constructed today are extremely complex. A cyberphysical attack against a network could have cascading and devastating effects on other portions of the information enterprise. To defend against a network wide attack, it is imperative that we know what is on our systems and their composition. We need to know what computers we have, what applications are running, what vulnerabilities exist and what networks are related to other networks. Only when armed with this type of information can we possibly adapt our countermeasures and protection procedures to counter an attack.

The objective of this project is to develop novel learning frameworks for non-equilibrium game-theoretic adaptive algorithms for systems in adversarial, dynamic and uncertain environments. The technical approach is to be inspired by interdisciplinary ideas from different fields, such as game theory, nonlinear adaptive learning theory, cognitive science and network security. The anticipated outcomes include the development of (i) level-k learning architectures for security, where decision makers are not perfectly rational and do not possess infinite intelligence; (ii) a learning-based moving target defense that reduces predictability; and (iii) a resilient learning framework to bandwidth depletion attacks. The contributions and impact on Army's objectives will be the ability to multiply engagement capability, and enable coordination of distributed, heterogeneous teams of manned, unmanned vehicles and humans in dynamic, adversarial and completely uncertain environments. The models, theories, techniques, and tools developed as part of the proposed research will lay the foundation for the DoD to develop more effective techniques against intelligent attackers with different levels of rationality and capabilities. For more details see our published work.

Intermittent Learning Framework for Smart and Efficient Cyber-Physical Autonomy

Funding Source: NSF CAREER CPS-1851588, NSF CAREER CPS-1750789,

 

Current learning algorithms cannot be easily applied in CPS due to their need for continuous and expensive updates, with the current triggered frameworks having fundamental limitations. Such limitations lead to the following questions. How can we incorporate and fully adapt to totally unknown, dynamic, and uncertain environments? How do we co-design the action and the intermittent schemes? How can we provide quantifiable real-time performance, stability and robustness guarantees by design? And how do we solve congestion and guarantee security? We will build on our multiyear experience and develop fundamental contributions to CPS by providing novel frameworks that will allow the fully autonomous operation in the face of unknown, bandwidth restricted, and adversarial environments.

As specific merits, the project will, (i) unify new perspectives of learning in engineering to enable smart autonomy, resiliency, bandwidth efficiency, robustness, real-time optimality and adaptation that cannot be achieved with the state-of-the-art approaches; (ii) develop intermittent deep learning methods for CPS that can mitigate sensor attacks by dynamically isolating the suspicious components and can handle cases of limited sensing capabilities; (iii) incorporate nonequilibrium game-theoretic learning in CPS with components that do not share similar mechanisms for decision making and do not have the same level of rationality due to heterogeneity and may differ in either their information obtained or their ability in utilizing it; and (iv) investigate ways to transfer intermittent learning experiences among the agents. For more details see the project's webpage and our published work.

Data-Driven Learning Techniques for Cyber-Physical-Situation Awareness in Defense Systems

Funding Source: ONR Minerva Research Initiative

 

The objective of this project is to investigate and develop novel data-driven learning techniques for realtime and adaptive cyber-physical situation awareness of adversarial activities, and feed information about the impact of those activities back to the security analysts. This will significantly enhance awareness and safety in defense systems by providing fast decision making along with, guarantees for mission completion and conditions for robustness. The guaranteed robustness of the proposed data-driven learning techniques will ensure fast prompt and/or automated decision making without reaching back to higher command levels.

The technical approach is to be inspired by interdisciplinary ideas from different fields, such as game theory, cognitive learning (specifically reinforcement learning), cyber-physical systems, and network security. The anticipated outcomes include transformative data-driven learning algorithms to engage the DoD security analysts in the characterization, recognition and mitigation of adversarial actions, with the support of rapid decision-making through prompt action, and recommendations/actions from "automated assistants." For more details see our published work.

Enforcement of Geofencing Policies for Commercial Unmanned Aircraft Systems

Funding Source: NSF SATC-1801611

Collaborators: R. Gerdes, M. Farhood, J. M. Park (Virginia Tech), M. Li (University of Arizona)

 

The adoption of services and applications that rely on Unmanned Aircraft Systems (UAS) is expected to continue its acceleration for the foreseeable future. Such services and applications include search and rescue, crop monitoring, real-time traffic monitoring, critical infrastructure inspections, and others. As UAS continue to proliferate, aviation regulatory agencies around the world are facing a challenging dilemma in terms of safely integrating UAS operations into their respective national airspace systems and enforcing their compliance to relevant regulations, including enforcement of no fly-zones. Current UAS lack effective on-board flight restrictions that would prevent them from entering critical airspace, e.g., airport runways and nuclear power plants. Furthermore, it is essential that the safety and privacy of members of the public be safeguarded from accidental and non-accidental UAS incursions. This project aims to address these critical needs by developing offensive and defensive measures for detecting, identifying, and bringing down UAS that violate controlled/restricted airspace in an automated, controlled, and reliable manner.

A three phase approach to thwarting a UAS encroaching on restricted airspace will be used: (1) detect the incursion using passive radar that exploits signals of opportunity and radio frequency (RF) communications/emissions from the encroacher itself; (2) deploy one or more defender UAS, capable of learning the motivations and behaviors of the encroacher, to pursue the UAS and gain and maintain proximity to it even should the encroacher take evasive action; and (3) have the defender UAS launch offensive measures that manipulate/compromise the sensor and actuation signals the encroacher relies on to stay airborne. For more details see our published work.

Enabling Secure and Resilient Extremely Fast Charging: A Software/Hardware-Security Co-Design Approach

Funding Source: Department of Energy

Collaborators: Ryan Gerdes (PI) and several others from Virginia Tech, Utah State, OnBoard Security, ChargePoint Inc., Ford Motor Co., and Commonwealth Edison Company

 

Extremely fast charging (XFC) has the potential to reduce the charging time of battery electric vehicles (BEV) to be equivalent to the filling time of internal combustion engine vehicles (ICEV), thus eliminating one of the few advantages ICEV still posses for light- and heavy-duty vehicles. Enabling XFC will, however, require coordination and cooperation between the grid, charging stations, and the vehicles themselves, which leads to an inevitable increase in the attack surface for all systems combined.

In securing the overall system, we must not only embrace traditional cybersecurity, which is chiefly concerned with communications and the operation of digital systems, but also cyber-physical systems security as the proper operation of XFC is critically dependent on systems' abilities to know about (sense) and interact with (actuate) the physical world. For more details see our published work.

Mobility in Severe Terrain Environments

Funding Source: NATO SPS G5176

Collaborators: V. Vantsevich (University of Alabama)

 

The proposed project's effort is to develop and demonstrate a new technology to radically enhance vehicle tactical and operational mobility and survivability by establishing agile and interactive dynamics of innovative vehicle sub-systems. The scope of the proposed project is fundamental and is based on applied research in the multi-disciplinary mechatronics areas including ground vehicle engineering, sensor design and application, electronics and controls.

The new technology will enable vehicles of any weight class, with any number of wheels, independently driven wheels, or through a drive-train a unique ability to maintain mobility through high-speed and rapid maneuvers in complex off-road environments. Ramifications from this technology will greatly increase crew safety, reduce roll-overs, and enables vehicles too rapidly and aggressively veer/steer or experience external blast/force in on-road, off-road, and poor terrain conditions while maintaining vehicle control and mobility. The proposed system is a vehicle by-wire sub-system that controls and monitors the vehicle's mobility based on input programs of the motions via any autonomous controller or human operator input. For more details see our published work.

Security of Underwater Cyber-Physical Systems

Funding Source: NAVSEA

Collaborators: D. Stilwell, M. Psiaki (Virginia Tech)

 

The convergence of systems on modern UUVs and the reliance of the industry on connectivity leads to a broad space for exploitable vulnerabilities. Unfortunately, due to current re-certification practices, software and/or hardware fixes to address such vulnerabilities could take months to appear. The goal of the proposed research is to increase the security of underwater cyber-physical systems (UCPS), which include the UUVs themselves and necessary supporting infrastructure, through reductions in attack surface, decreased time to patch, and increased resiliency to attacks, thus ensuring safety, integrity, and efficiency.

The overall objectives of this project are to assess cybersecurity risks for UUVs and to propose practical countermeasures. For more details see our published work.

Reinforcement Learning for Optimal Adaptive Feedback Control and Games

Collaborators: F. L. Lewis (U. Texas), J. P. Hespanha (UCSB), W. Dixon (U. Florida), G. R. Hudas (US Army TARDEC), R. Babuska (TU Delft), D. Vrabie (PNNL), R. Kamalapurkar (Oklahoma State U.), S. Bhasin (IITD)

 

Adaptive control and optimal control represent different philosophies for designing feedback control systems. These methods have been developed by the Control Systems Community of engineers. Optimal controllers minimize user prescribed performance functions and are normally designed offline by solving Hamilton-Jacobi (HJ) design equations, for example, the Riccati equation, using complete knowledge of the system dynamical model. However, it is often difficult to determine an accurate dynamical model of practical systems.

We propose new techniques based on approximate dynamic programming that allow the design of adaptive control systems with novel structures that learn the solutions to optimal control problems and Nash/Stackelberg games in real time by observing data along the system trajectories. Complicated Lyapunov stability proofs ensure boundedness of the closed-loop signals. For more details see our published work.