Predicting Trust in Automated Systems: Validation of the Trust of Automated Systems Test (TOAST)

April, 2022
IDA document: D-33088
FFRDC: Systems and Analyses Center
Type: Documents
Division: Operational Evaluation Division
Daniel J. Porter, Caitlan A. Fealing See more authors
Within the defense community, automated systems are currently used to perform search and rescue missions and to assume control of aircraft to avoid ground collision. Until recently, researchers have only been able to gain insights on trust levels by observing a human’s reliance on the system, so it was apparent that researchers needed a validated method of quantifying how much an individual trusts the automated system they are using. IDA researchers developed the Trust of Automated Systems Test (TOAST scale) to serve as a validated scale capable of measuring how much an individual trusts a system. This presentation will outline the nine-item TOAST scale’s understanding and performance elements and how it can effectively be used in a defense setting. We believe that this scale should be used to evaluate the trust level of any human using any system, including predicting when operators will misuse or disuse complex automated and autonomous systems.