Research Scientist

Dr. Matthew Johnson is a research scientist in the area of human-machine teaming for technologies such as robotics, artificial intelligence, software agents, and autonomous vehicles, in a variety of domains including disaster response, space applications, aviation, and military operations.

Matt came to IHMC out of the military, where he served as a naval aviator, flying both fixed wing aircraft and helicopters. Matt continued in the Navy Reserves retiring after 20 years of service. Matt obtained his undergraduate degree in Aerospace Engineering at the University of Notre Dame (go Irish!) prior to entering the Navy. He obtained a Masters of Science in Computer Science from Texas A&M – Corpus Christi while on active duty. Matt completed his Ph.D. from Delft University in the Netherlands; his thesis proposed a new approach to human-machine system design called Coactive Design.

In addition to his research, Matt is currently the IHMC coordinator for the joint UWF/IHMC PhD program on Intelligent Systems and Robotics and is a UWF Director of Research Professor advising PhD students in the program.

Matt has been a researcher with IHMC since 2002. Matt is passionate about making technology more flexible, resilient, and effective, through human-machine teamwork. His research areas include human-machine teaming, human-machine system design, human-centered computing, human-machine interface design, and multi-robot control. Currently Matt is involved in several projects:

Current Projects:

• Working with Galois on COEUS: A Co-Training Methodology for Improved Performance in Human-Machine Teams
• Virtual Reality Workbench: Leverage VR to derisk new technology concepts
• Working with Visual Semantics on Collaboration and Secure Tasking for Multi-Agent Swarms
• Working with local SWAT to set up a drone program
• DARPA Artificial Social Intelligence for Successful Teams (ASIST)
• Working with local police department to set up a drone program

Previous Projects:

• DARPA Context Reasoning for Autonomous Teaming (CREATE)
• Capture-the-Flag teaming simulation video
• Scaling Teamwork in Captue-the-flag video
• Capture-the-flag hardware video
• Reinforcement Learning simulation video
• Reinforcement Learning transfer to hardware video
• Working with Navy Post Graduate School on how to design AI to team more effectively with people
• Working with Modus Operandi on developing team performance metrics
• Working with ONR on developing fast behaviors for humanoid robots (Human-Robot Teamwork video)
• Working on a NASA project to use AI to inform novice technicians how to more effectively use complex sensors
• Working with AeroVironment to explore the complexities of people controlling large numbers of high altitude vehicles
• Working with NASA on characterizing the nature of foundational and applied research that need to evolve in order to develop advanced intelligent technologies that reduce cost, enhance performance and improve safety.
• National Robotics Initiative: Toward Humanoid Avatar for Co-exploration of Hazardous Environments. Developing humanoid behaviors and advanced interface concepts to enable complex work using both Boston Dynamics Atlas robot and NASA’s Valkyrie robot.
• Working with Xerox PARC to brainstorm human-machine teaming concepts
• DARPA Aircrew Labor In-Cockpit Automation System (ALIAS) to develop a robotic copilot (video)
• Nissan Fleet Management for Autonomous Vehicles
• The DARPA Robotics Challenge (DRC) for disaster response (video)
• AFRL Micro-Air Vehicles to develop a novel UAV interface (video)
• NASA rotorcraft noise minimization
• OZ flight display (video)
• DARPA Augmented Cognition project to develop technology to enhance human performance
• NASA Human-Robot Teamwork for exploration
• DARPA Learning Locomotion quadrpedal walking over complex terrain (walking video, technical summary video)
• ARL applying semantic technologies to support information gathering and sharing for the soldier (large video so be patient)
• ONR Coordinated Operations for multiple people working with multiple robots (video)

Presentations available on the web:

03/26/2021 – NASA presentation titled “The Unseen m:N Challenge” as part of the NASA m:N working Group
NASA webinar titled “Automation Myths and Human-Machine Teaming Virtues”

Recent Invited Talks:

• 10 NOV 2022: SCSP-RUSI Human-Machine Collaboration and Teaming “Current and Future Capabilities”
• 31 OCT 2022: Expert Workshop on the Responsible Use of AI in Military Systems
• 13 SEP 2022: DARPA Forward – Advancing the Horizons of National Security- “Systems of Autonomy”

Additional Qualifications:

• Commercial Pilot Ratings
  • Airplane Single Engine Land
  • Rotorcraft-Helicopter
  • Instrument Airplane and Helicopter
• Small Unmanned Aircraft Systems

You can find Dr. Johnson’s CV here.

Outside Interests
When not working on robots for IHMC he enjoys time with his family, playing soccer, traveling, and supporting the Children of Christ Home orphanage in Galette Chambon, Haiti. Matt also developed and maintains medical record software for the medical clinic adjacent to the orphanage. This software is now in two different clinics in Haiti, one in Uganda and another in Liberia.