Researchers at CU 麻豆影院 advancing more trustworthy autonomous systems with U.S Air Force
Allie Anderson and Torin Clark at CU 麻豆影院 are conducting research into how humans and artificial intelligence systems work together.
The pair are part of a multi-university research team commissioned by the Air Force Office of Scientific Research to study trust in autonomous systems. It is an important and complex problem.
鈥淭rust is a dynamic human state with multiple dimensions - it鈥檚 different for each individual and the specific system you鈥檙e using. Trusting a self-driving car if you want to go to sleep in the backseat is different than trusting Alexa to tell you the weather,鈥 said Anderson, an assistant professor in the Ann and H.J. Smead Department of Aerospace Engineering Sciences at the 麻豆影院.
The work has broad applications across the technological spectrum, but the Air Force is particularly interested due to increasing integration of autonomy in military systems and the uncertainties faced by soldiers using them, said Anderson.
鈥淭here are many applications where autonomous systems may be used and 鈥 particularly with space-based applications 鈥 the human isn鈥檛 onsite with a satellite to have additional context, and you can鈥檛 always get all the data in real-time. We need to understand how users trust and view that type interaction with autonomy across a variety of situations,鈥 Anderson said.
The initiative aims to build metrics and models for real time predictions of trust, with the goal of helping developers create better AI systems in the future, said Clark, an associate professor in Smead Aerospace.
鈥淪pace and military autonomy represent critically challenging environments and being able to estimate and predict human-operator trust will enable systems to intelligently alter their behaviors to complement their human teammates,鈥 Clark said.
During the research, test subjects will be fitted with wearable sensors while they conduct tasks with AI systems. The sensors will collect physiological data on the body鈥檚 responses 鈥 things like heart rate and respiration 鈥 as well as how users physically interact with the systems. That includes where they are looking on a computer screen, the buttons they click, and how long they take to do an activity requested by the AI powered system.
鈥淚t鈥檚 exciting to work in this emerging field where there are important questions that need to be answered to move out of the laboratory and into operations,鈥 Anderson said.
The three-year, $900,000 grant is being led overall by the University of California, Davis. CU 麻豆影院鈥檚 work represents nearly $500,000 of the total award.