Skip to main content

Georgia Tech researchers upgrade robot arm with point-and-click interface

Georgia Tech Creates Point and Click Method for Controlling Robots
The Georgia Institute of Technology has developed a new, intuitive method for controlling a robotic arm: Point and click. While not exactly like the adventure games of old, it definitely draws its inspiration from the ability to highlight objects and perform a small selection of preselected tasks.

Although typical robotic arm controls offer a wide variety of options thanks to six degrees of motion, that can be cumbersome for people just getting to grips with the technology. What the new solution looks to do, is make it possible for novice robotics owners to utilize the technology in a manner that has a much shorter and shallower difficulty curve.

Recommended Videos

“Roboticists design machines for specific tasks, then often turn them over to people who know less about how to control them,” said David Kent, a Georgia Tech robotics doctoral student who headed up the project. “Most people would have a hard time turning virtual dials if they needed a robot to grab their medicine. But pointing and clicking on the bottle? That’s much easier.”

While simpler on the surface, such a system is a lot more complicated under the hood. Instead of displaying 3D information to the user, they simply offer a video feed. However, the arm itself needs to understand the 3D environment and know that when a person clicks on an object in the background and tells it to pick it up, it must differentiate that from objects in the foreground. It needs to know the distance that it must travel and the correct angle to “attack” it from.

The algorithm that the research team has come up with is capable of analyzing the geometry of objects, even making assumptions about them when the camera can’t see their entirety. This is something that the human brain does automatically, the researchers explained, but it was a challenge to make the robotic arm infer that detail for itself.

Although this technique of control does bequeath much of the responsibility of control to the algorithm and the arm, the system is actually less error prone than giving humans full control. In a trial, researchers found the point and click method delivered only one mistake per task, whereas the more traditional six degrees of motion control method had as many as four per task.

By giving users control over what to grab and how to do so when the arm is in the right position, researchers hope that robotic technology could more easily be adopted by those without training, or with limited mobility themselves, like the elderly. There are also potential applications for such robotic arms in sensitive settings, like search and rescue operations or in space travel.

Jon Martindale
Jon Martindale is a freelance evergreen writer and occasional section coordinator, covering how to guides, best-of lists, and…
The 10 best gaming monitors of 2024: tested and reviewed
Alienware ultrawide OLED on a desk.

Editor’s note: Gaming monitors are always hot sellers on Black Friday and Cyber Monday. We're expecting some really great discounts on some of the top models, including high-end OLED gaming monitors, super-fast refresh rate screens, and more budget-oriented fare. There are tons of fantastic monitor deals available now, and they're bound to get even better on Black Friday and Cyber Monday. Make sure to check out our other Black Friday deals or Cyber Monday deals for even more bargains on TV, headphones, and more.

A good monitor is essential for gaming due to its significant impact on the overall experience. There are a ton of options if you are on the hunt for one of the best gaming monitors, but for us, Alienware's 34 QD-OLED still takes the cake in 2024. It's not the display for everyone, though, and after reviewing dozens of the top gaming monitors, we've settled on a list of displays that offer great gaming performance for any budget or purpose.

Read more
Nvidia’s RTX 5070 Ti may trail behind the RTX 4080
Power adapter on the RTX 4070 Ti Super graphics card.

As we inch closer to the launch of Nvidia's RTX 50-series, new leaks keep cropping up daily. Today, one of the most prolific leakers in the PC hardware space shared a glimpse of the specs for Nvidia's upcoming RTX 5070 Ti. Although it's not the full spec sheet, one specification in particular tells us that we may be dealing with a GPU similar to the RTX 4080, which is still one of Nvidia's best graphics cards. But is that good news?

All of this is unconfirmed. Kopite7kimi is one of the accounts that most of us turn to when we want some new scoop on upcoming PC hardware, but this time, the leaker didn't post on X (Twitter), and has instead shared some specs directly with VideoCardz. Let's dig in.

Read more
I tried the RayNeo Air 2s glasses and they’re on sale for Black Friday
RayNeo Air 2s on custom Steam Deck - Briley Kenney Digital Trends_edited

With the holidays coming, I've been trying a spat of unique VR and AR devices. One pair I got my hands on, called the RayNeo Air 2s, basically gives you a portable 201-inch display that you can put on and use anytime, anywhere. They work with Android, Mac, Nintendo Switch, PS5, and -- my favorite -- Steam Deck. Our team has used the RayNeo Air 2 previously and also gave them high marks. Fun Fact I learned from reading that, RayNeo is actually a TCL brand. As for what I think of them, we'll get to that. For now, I want to talk about the crazy RayNeo Black Friday deals that have just dropped.

 
RayNeo Air 2 -- $184, was $380 51% off

Read more