Human Robotic Interaction

What Is It?

The Human Robotic Interaction research program focuses on the abilities of teams of humans and autonomous systems to: (1) communicate clearly about their goals, abilities, plans, and achievements; (2) collaborate to solve problems, especially when situations exceed autonomous capabilities; and (3) interact via multiple modalities both locally and remotely.

How Does It Work?

For effective human-robot interaction, it is essential that the robots have good models of the humans they are interacting with and effective mechanisms for human-robot interaction and communication. Roles and responsibilities must be assigned according to the capabilities of both the human and the robot. It must be easy for the human to effect control, to assess the situation, and to assist the robot.

What Will It Accomplish?

This effort will develop the underlying principles and technology that will enable autonomous vehicles and robots to work with people as capable partners.

The Navy and Marine Corps are currently investing in a variety of heterogeneous naval unmanned systems to be operated from small host platforms. In many cases, significant limitations exist on the manning available for these systems
in terms of both numbers and skill types. Increasing the level of automation can have a significant impact on reducing manning requirements, but despite advances in autonomous control technologies, mission management often still requires a human’s cognitive skills, judgment, decision-making and tactical understanding.  

The Office of Naval Research (ONR) Human Robotic Interaction Program is investiing in basic research in areas such as flexible, robust and scalable human-robot teams in dynamic and uncertain environments integration of cognitive models, action schemes and statistical estimation. ONR is also focused on integrating behavior models and distributed control; assigning tasks with different, potentially incompatible goals, and enabling unmanned vehicles to execute them; robust, intuitive, multimodal (e.g., natural language, gestures, pointers, etc.) human-robot dialogue systems; and learning from instruction during task execution.

Applied research efforts are focused on the human interface technology to support small teams of co-located and distributed users in managing larger numbers of unmanned systems and sharing unmanned systems resources, autonomy, decision aids and situational awareness tools to support collaborative decision-making among teams of operators and unmanned systems, mixed-initiative interfaces, and integrating large amounts of data from multiple sources into unmanned system mission displays.

This research could equip robot sentries to conduct dangerous missions while minimizing human risk, such as explosive ordnance disposal, operating in chemical, biological and nuclear (CBN) conditions, or searching for concealed CBN items. ONRs research could also greatly reduce manning requirements for forward-deployed units that were operating unmanned and/or autonomous systems.

Research Challenges and Opportunities

  • How do we create interfaces that integrate the information from multiple robots into a cohesive display, are intuitive for humans and enable comprehensive interactions among multiple humans and robots, and disseminate information to multiple echelons?
  • How is the commander’s intent transferred to the robots?
  • Who controls the change in autonomy levels as the emergent mission needs dictate?
  • What is the collaborative behavior for the use of multiple vehicles between multiple operators who may be sharing resources and assets?

Point of Contact

Tom McKenna, (703) 696-4503
tom.mckenna@navy.mil

* Some pages on this website provide links which require Adobe Reader to view.