Skip to main content

Social robots taught to ask for clarification when confused about a command

social robot question socialrobot
Nick Dentamaro / Brown University
Robots already work the front desk in some hotels, run cash registers at a few fast food restaurants, and clean up around the house for us. Though they’ve been programmed to receive to commands, they rarely engage in meaningful, dynamic communications with us like other people do. But if social robots are ever going to truly catch on, they’ll need to learn to communicate and pick up on social cues.

A team of researchers from Brown University are working to instill this social competence into robots, recently developing an algorithm that allows them to perform tasks better by collaborating with people.

Recommended Videos

In the study, conducted by Brown’s Humans to Robots Laboratory, the robots were programmed to ask for clarification. When a person told the robot to grab a certain object, the robot could ask “Which one?” if the command was ambiguous. This communication allowed the robot to perform tasks 25 percent faster and 2.1 percent more accurate than a state-of-the-art baseline, according to the research, which will be presented at the International Conference on Robotics and Automation in Singapore this spring.

Reducing Errors in Object-Fetching Interactions through Social Feedback

The goal for the Brown lab at this point is less about creating flawless machines than it is about creating machines that can catch and correct their mistakes.

Please enable Javascript to view this content

“It is very hard to go from 90 percent accuracy to 99.9 percent accuracy,” Stefanie Tellex, computer science professor and lead researcher, told Digital Trends. “Yet 90 percent accuracy means the robot will fail on one in ten interactions. If it is interacting with you every day, that means it will fail every single day. With our technology though, the robot will automatically detect the failure and ask questions.

“Using this feedback loop, a failure isn’t the end of the story,” she added. “It can ask a question, and recover.”

The question-asking algorithm is a step forward for Tellex and her team, which previously created an algorithm that could respond to verbal and gesture commands from people. However, the new system does becomes confused when asked to retrieve an object among many other similar objects on the table. The algorithm still worked surprisingly well for untrained participants though, who even assumed it could understand and respond to complex phrases that it wasn’t programmed to comprehend.

“We envision robots assisting astronauts in space,” Tellex said, pointing out that the research was funded in part by NASA. She also thinks these machines could help workers here on Earth from the assisting patients at hospitals to people at home.

Dyllan Furness
Former Digital Trends Contributor
Dyllan Furness is a freelance writer from Florida. He covers strange science and emerging tech for Digital Trends, focusing…
Dodge’s Charger EV muscles up to save the planet from ‘self-driving sleep pods’
dodges charger ev muscles up to save the planet from self driving sleep pods stellantis dodge daytona

Strange things are happening as the electric vehicle (EV) industry sits in limbo ahead of the incoming Trump administration’s plans to end tax incentives on EV purchases and production.

The latest exemple comes from Dodge, which is launching a marketing campaign ahead of the 2025 release of its first fully electric EV, the Daytona Charger.

Read more
Many hybrids rank as most reliable of all vehicles, Consumer Reports finds
many hybrids rank as most reliable of all vehicles evs progress consumer reports cr tout cars 0224

For the U.S. auto industry, if not the global one, 2024 kicked off with media headlines celebrating the "renaissance" of hybrid vehicles. This came as many drivers embraced a practical, midway approach rather than completely abandoning gas-powered vehicles in favor of fully electric ones.

Now that the year is about to end, and the future of tax incentives supporting electric vehicle (EV) purchases is highly uncertain, it seems the hybrid renaissance still has many bright days ahead. Automakers have heard consumer demands and worked on improving the quality and reliability of hybrid vehicles, according to the Consumer Reports (CR) year-end survey.

Read more
U.S. EVs will get universal plug and charge access in 2025
u s evs will get universal plug charge access in 2025 ev car to charging station power cable plugged shutterstock 1650839656

And then, it all came together.

Finding an adequate, accessible, and available charging station; charging up; and paying for the service before hitting the road have all been far from a seamless experience for many drivers of electric vehicles (EVs) in the U.S.

Read more