Published: Nov. 17, 2023 By

Featured on CBS Sunday Morning


Sean Humbert discusses the team's award-winning research developing autonomous robots that can navigate challenging conditions. The team demonstrated the robots for CBS during a recent visit to the Edgar Mine in Idaho Springs, CO.

Recent Grant/Competition Partners

Since completion of the Subterranean Challenge, faculty and students have been conducting follow-on research and competitions with multiple corporate and government partners.

  • Lockheed Martin
  • National Institutes of Standards and Technology - 2023 First Responder UAS 3D Mapping Challenge
  • National Science Foundation
  • United States Department of Agriculture - National Institute of Food and Agriculture

Robotics Partners at CU 麻豆影院

Research further advancing the capabilities of the Subterranean Challenge Robots is being led by numerous CU 麻豆影院 laboratories.

One thousand feet underground, a four-legged creature scavenges through tunnels in pitch darkness. With vision that cuts through the blackness, it explores a spider web of paths, remembering its every step and navigating with precision. The sound of its movements echo eerily off the walls, but it is not to be feared 鈥 this is no wild animal; it is an autonomous rescue robot.

Initially designed to find survivors in collapsed mines, caves, and damaged buildings, that is only part of what it can do.

Created by a team of 麻豆影院 researchers and students, the robots placed third as the top US entry and earned $500,000 in prize money at a Defense Advanced Projects Research Agency Subterranean Challenge competition in 2021.

Going Futher

Two years later, they are pushing the technology even further, earning new research grants to expand the technology and create new applications in the rapidly growing world of autonomous systems.

鈥淚deally you don鈥檛 want to put humans in harm鈥檚 way in disaster situations like mines or buildings after earthquakes; the walls or ceilings could collapse and maybe some already have,鈥 said Sean Humbert, a professor of mechanical engineering and director of the Robotics Program at CU 麻豆影院. 鈥淭hese robots can be disposable while still providing situational awareness.鈥

The team developed an advanced system of sensors and algorithms to allow the robots to function on their own 鈥 once given an assignment, they make decisions autonomously on how to best complete it.

Advanced Communication

A major goal is to get them from engineers directly into the hands of first responders. Success requires simplifying the way the robots transmit data into something approximating plain English, according to Kyle Harlow, a computer science PhD student.

鈥淭he robots communicate in pure math. We do a lot of work on top of that to interpret the data right now, but a firefighter doesn鈥檛 have that kind of time,鈥 Harlow said.

To make that happen Humbert is collaborating with Chris Heckman, an associate professor of computer science, to change both how the robots communicate and how they represent the world. The robots鈥 eyes 鈥 a LiDAR sensor 鈥 creates highly detailed 3D maps of an environment, 15 cm at a time. That鈥檚 a problem when they try to relay information 鈥 the sheer amount of data clogs up the network.

鈥淗umans don鈥檛 interpret the environment in 15 cm blocks,鈥 Humbert said. 鈥淲e鈥檙e now working on what鈥檚 called semantic mapping, which is a way to combine contextual and spatial information. This is closer to how the human brain represents the world and is much less memory intensive.鈥

High Tech Mapping

The team is also integrating new sensors to make the robots more effective in challenging environments. The robots excel in clear conditions but struggle with visual obstacles like dust, fog, and snow. Harlow is leading an effort to incorporate millimeter wave radar to change that.

鈥淲e have all these sensors that work well in the lab and in clean environments, but we need to be able to go out in places such as Colorado where it snows sometimes,鈥 Harlow said.

Where some researchers are forced to suspend work when a grant ends, members of the subterranean robotics team keep finding new partners to push the technology further.

Autonomous Flight

Eric Frew, a professor of aerospace at CU 麻豆影院, is using the technology for a new National Institute of Standards and Technology competition to develop aerial robots 鈥 drones 鈥 instead of ground robots, to autonomously map disaster areas indoors and outside.

鈥淥ur entry is based directly on the Subterranean Challenge experience and the systems developed there,鈥 Frew said.

Some teams in the competition will be relying on drones navigated by human operators, but Frew said CU 麻豆影院鈥檚 project is aiming for an autonomous solution that allows humans to focus on more critical tasks.

Although numerous universities and private businesses are advancing autonomous robotic systems, Humbert said other organizations often focus on individual aspects of the technology. The students and faculty at CU 麻豆影院 are working on all avenues of the systems and for uses in environments that present extreme challenges.

鈥淲e鈥檝e built world-class platforms that incorporate mapping, localization, planning, coordination 鈥 all the high level stuff, the autonomy, that鈥檚 all us,鈥 Humbert said. 鈥淭here are only a handful of teams across the world that can do that. It鈥檚 a huge advantage that CU 麻豆影院 has.鈥

    Additional Images

    PhD student Kristen Such reviewing LiDAR maps generated by the robots in a mine.

    A subterranean robot navigating through the Edgar Mine in Idaho Springs, CO.

    PhD student Kyle Harlow inspecting one of the robots before activation.