麻豆影院

Skip to main content

Professor earns two major grants to advance AI for autonomous systems

Zach Sunberg

Zach Sunberg

Zach Sunberg鈥檚 research developing better artificial intelligence systems is getting a major boost from two federal grant awards.

Sunberg is receiving a $599,000, five-year and is a partner on a related $4 million multi-university initiative from the U.S. Office of Naval Research.

Both projects focus on advancing game theory algorithms so AI systems can better solve problems in real-time in the field.

鈥淚鈥檓 excited to receive the recognition that I鈥檓 looking at important problems to solve in both of these areas,鈥 Sunberg said. 鈥淥NR shows the relevance for defense applications, and the NSF award focuses on making our nation and our world a better place.鈥

Sunberg is an assistant professor in the Ann and H.J. Smead Department of Aerospace Engineering Sciences at the 麻豆影院. His research focuses on autonomous systems and AI, with an emphasis on game theory.

Although game theory has origins in solving tabletop board games and card games, it is a broad field of research that studies problem-solving in complex, real-world situations.

鈥淵ou might think of a game as a board game, but any situation where multiple agents are interacting and have their own goals can be mathematically represented as a game. Poker has clear rules, but so does driving a car; there are just a lot more variables,鈥 Sunberg said.

AI systems like those used in self-driving cars typically rely on offline reinforcement learning. In such a system, automakers use historical data collected from a fleet of vehicles to optimize an algorithm to react to future situations. Sunberg is seeking to develop online decision-making systems, where an AI can think in real time to interact with situations that do not match historical data.

鈥淭his has previously been considered a computationally intractable problem鈥 Sunberg said. 鈥淏ut our lab recently had a breakthrough with single-agent planning where we proved we did not need a lot of computation even in a large state space. What we want to do next is work on more complex multi-agent situations.鈥

The research focuses on a framework used by scientists and engineers to model possible outcomes when full data is not available, called partially observable Markov stochastic games.

鈥淎n application is airborne collision avoidance. In the past, the other pilot鈥檚 actions would be modeled as a probability distribution. That wasn鈥檛 satisfying to me. The other pilot is a decision maker themselves, so it would be better to model as a multi-agent game, but we don鈥檛 know how to solve partially observable games like that using online systems,鈥 Sunberg said.

The research from the NSF grant has applications across an array of autonomous systems, from search and rescue robots, to self-driving cars, to how satellites navigate while orbiting the Earth. The Navy award is focused more on AI deception and counter deception in the military realm.

鈥淎n enemy is going to try to deceive you in some way, so we want to focus on how that can happen and how do we make AI resistant to it. We鈥檙e also looking at developing AI that can deceive an adversary. If you have a drone that you want to avoid enemy air defenses, how can it use bluffing to help it do that,鈥 Sunberg said.

The ONR award is brings together four universities. The project is being led by the Georgia Institute of Technology with partners at the University of California Santa Barbara, CU 麻豆影院, and the University of Texas at Austin. Sunberg鈥檚 portion of the $4 million grant is worth roughly $1 million.

鈥淭he current most widely used methods for AIs, these offline systems, are really a function approximater. It鈥檚 kind of an intuitive reaction or instinct. We want an AI that can go further, like people, and think and deliberate about a situation. There鈥檚 huge potential with this work,鈥 he said.