DATAWorks 2021: Characterizing Human-Machine Teaming Metrics for Test and Evaluation

April, 2021
IDA document: D-21564
FFRDC: Systems and Analyses Center
Type: Documents
Division: Operational Evaluation Division
Authors:
Authors
Heather M. Wojton, Brian D. Vickers, Kristina A. Carter, David A. Sparrow, Leonard D. Wilkins, Caitlan A. Fealing See more authors
The Department of Defense and partner organizations are developing advanced machine systems that are intended to partner with humans and engage in teamwork to accomplish missions. Given that these human-machine team (HMT) systems have never gone through test and evaluation (T&E), this initial effort looks at the new challenges and provides guidance associated with HMTs. This presentation (1) defines human-machine teaming, (2) describes new challenges in evaluating HMTs, and (3) provides a framework for the categories of metrics that are important for the T&E of HMTs.