Skip to main content

Like a real-life mech, MIT engineers use VR to put you in the head of a robot

Operating Robots with Virtual Reality
Researchers from the Massachusetts Institute of Technology’s Computer Science and Artificial Intelligence Lab (CSAIL) have come up with a smart way to combine two of the most exciting emerging technologies — virtual reality (VR) and
Recommended Videos
robotics — by creating a smart new telepresence control system. Using one of Rethink Robotics’ Baxter robots, a VR headset, and maybe a page or two from mecha anime like the classic Mobile Suit Gundam Wing, they created a smart head-mounted “sensor display” system which puts human operators in the head of the robot they are controlling.

“A lot of jobs are difficult to do remotely, particularly in manufacturing and industry,” Jeffrey Lipton, one of the postdoctoral researchers who worked on the project, told Digital Trends. “A system like this could one day allow humans to supervise robots from a distance. This would enable employees to work from home, and could even open up manufacturing jobs to people with physical limitations, [such as those] who can’t lift heavy or bulky objects. Many industrial jobs are also terrible for human health — imagine servicing the inside of an airplane or working out on an oil rig. They can be dangerous, cramped and uncomfortable, but right now they need a human mind to understand, make decisions, and do movements. We think this model of teleoperation could allow us to keep humans safe and away from these sites while leveraging human mental capabilities.”

Jason Dorfman/MIT CSAIL
Jason Dorfman/MIT CSAIL

MIT’s smart system embeds the user in a virtual reality control room with multiple sensor displays, allowing the user to see everything the robot is seeing at any given moment. To execute tasks, the human then employs gestures — picked up courtesy of hand controllers — which are mirrored by the robot. Controls accessible by the human user appear virtually, rather than being physical controls. This allows them to change depending on what the robot has to carry out at any given time.

“We hope to extend this work to many different robots and scale up the trials to tasks beyond assembly,” Lipton continued, describing future research the CSAIL scientists hope to carry out. For more on the Baxter project, you can check out a research paper published earlier this year, titled “Baxter’s Homunculus: Virtual Reality Spaces for Teleoperation in Manufacturing.”

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Valve Index VR goes on sale again Monday in time for Half-Life: Alyx
Valve Index VR

Valve announced that the Index VR headset will be back in stock for a limited time this Monday, March 9. The Steam creator revealed the return of the anticipated headset on Twitter after weeks of it being out of stock due to Coronavirus related issues.

https://twitter.com/valvesoftware/status/1235311669045272577?s=21

Read more
Range Rover’s first electric SUV has 48,000 pre-orders
Land Rover Range Rover Velar SVAutobiography Dynamic Edition

Range Rover, the brand made famous for its British-styled, luxury, all-terrain SUVs, is keen to show it means business about going electric.

And, according to the most recent investor presentation by parent company JLR, that’s all because Range Rover fans are showing the way. Not only was demand for Range Rover’s hybrid vehicles up 29% in the last six months, but customers are buying hybrids “as a stepping stone towards battery electric vehicles,” the company says.

Read more
BYD’s cheap EVs might remain out of Canada too
BYD Han

With Chinese-made electric vehicles facing stiff tariffs in both Europe and America, a stirring question for EV drivers has started to arise: Can the race to make EVs more affordable continue if the world leader is kept out of the race?

China’s BYD, recognized as a global leader in terms of affordability, had to backtrack on plans to reach the U.S. market after the Biden administration in May imposed 100% tariffs on EVs made in China.

Read more