Skip to main content

Smart gloves can recognize American Sign Language and convert to text

gloves american sign language text 30142539 l
Monika Wisniewska/123RF
One of the areas where it’s been truly amazing to watch technology make progress over the past few years is in accessibility. From gadgets that are designed to help blind people to see the world around them, to assistive technology that can help paralyzed people to walk, it’s a pleasure to be able to write about technology that can profoundly transform people’s lives for the better.

The latest potential example? A low-cost smart glove created by researchers at the University of California San Diego, which promises to automatically translate American Sign Language (ASL) into digital text that appears on a corresponding computer or smartphone. To use the glove, the wearer simply signs letters in the ASL alphabet, which are then recognized by way of variances in the electrical resistance. These variances allow an onboard computer to work out which letter is being signed, and then to relay this information via Bluetooth — no cameras required.

Recommended Videos

“The key innovative element of our device is the use of a conductive polymer composite at the knuckles, which are highly sensitive to bending and stretching,” Dr. Darren Lipomi, head of UC San Diego’s Lipomi Research Group, told Digital Trends. “There are other gesture-recognition gloves out there, but ours is the first to use extremely simple components that can be replicated by other researchers in the field of stretchable, wearable electronics to test their materials.”

The components in the glove add up to less than $100 in cost, making this a potentially affordable solution to a challenging problem.

Image used with permission by copyright holder

“The [biggest] challenge of the project was one of integration,” Lipomi continued. “My research team is made up of chemists, chemical engineers, and materials scientists — me included. We are not specialists in electronics. The key was getting advanced materials to interact with electronic components one might find at a hardware store.”

Lipomi says that “essentially all the credit” goes to his graduate student, Timothy O’Connor, who worked tirelessly for two years to complete the project.

As to what’s next for the project, Lipomi said the next step is to incorporate tactile sensations on the interior of the glove. In addition to signing, he said he thinks there are also commercializable aspects in both virtual and augmented reality, as well as robotic surgery, medical training, and gaming.

A paper describing the work was published in the journal PLOS One.

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
The UK’s Wayve brings its AI automated driving software to U.S. shores
wayve ai automated driving us driver assist2 1920x1152 1

It might seem that the autonomous driving trend is moving at full speed and on its own accord, especially if you live in California.Wayve, a UK startup that has received over $1 billion in funding, is now joining the crowded party by launching on-road testing of its AI learning system on the streets of San Francisco and the Bay Area.The announcement comes just weeks after Tesla unveiled its Robotaxi at the Warner Bros Studios in Burbank, California. It was also in San Francisco that an accident last year forced General Motors’ robotaxi service Cruise to stop its operations. And it’s mostly in California that Waymo, the only functioning robotaxi service in the U.S., first deployed its fleet of self-driving cars. As part of its move, Wayve opened a new office in Silicon Valley to support its U.S. expansion and AI development. Similarly to Tesla’s Full-Self Driving (FSD) software, the company says it’s using AI to provide automakers with a full range of driver assistance and automation features.“We are now testing our AI software in real-world environments across two continents,” said Alex Kendall, Wayve co-founder and CEO.The company has already conducted tests on UK roads since 2018. It received a huge boost earlier this year when it raised over $1 billion in a move led by Softbank and joined by Microsoft and Nvidia. In August, Uber also said it would invest to help the development of Wayve’s technology.Just like Tesla’s FSD, Wayve’s software provides an advanced driver assistance system that still requires driver supervision.Before driverless vehicles can legally hit the road, they must first pass strict safety tests.So far, Waymo’s technology, which relies on pre-mapped roads, sensors, cameras, radar, and lidar (a laser-light radar), is the only of its kind to have received the nod from U.S. regulators.

Read more
Aptera’s 3-wheel solar EV hits milestone on way toward 2025 commercialization
Aptera 2e

EV drivers may relish that charging networks are climbing over each other to provide needed juice alongside roads and highways.

But they may relish even more not having to make many recharging stops along the way as their EV soaks up the bountiful energy coming straight from the sun.

Read more
Ford ships new NACS adapters to EV customers
Ford EVs at a Tesla Supercharger station.

Thanks to a Tesla-provided adapter, owners of Ford electric vehicles were among the first non-Tesla drivers to get access to the SuperCharger network in the U.S.

Yet, amid slowing supply from Tesla, Ford is now turning to Lectron, an EV accessories supplier, to provide these North American Charging Standard (NACS) adapters, according to InsideEVs.

Read more