Skip to main content

From translating hearing aids to sign-language gloves, amazing assistive tech

Waverly Labs Pilot
Image used with permission by copyright holder

Think that assistive technology for the deaf and hard of hearing community is all about your run-of-the-mill hearing aids here in 2018? Think again!

From signing robot arms to mind-reading hearing aids, the next few years are going to be pretty darn amazing for accessibility technology if this list is anything to go by. Here are some of the most impressive tech projects we’ve come across in this area.

Project Aslan

3D Hubs x Aslan Project - Sign Language Humanoid Robot

Signing is all well and great, but like any language it’s not much good if one side of the conversation doesn’t speak it. That’s where a multi-year robotics project from researchers at Belgium’s University of Antwerp comes into play.

That have developed a 3D-printed robotic hand capable of translating spoken and written words into sign language gestures. The device recognizes these words using a webcam, and then communicates them to the user through “fingerspelling,” a mode of sign language which spells out words letter-by-letter with single hand gestures.

Though not currently available, Project Aslan’s robot hand can be 3D printed for just a few hundred bucks, and promises to be small enough to fit in a rucksack.

Cameras that can translate signing

KinTrans Inclusive Communication Inclusive Community

A robot which can turn speech into sign language is good, but for a full conversation to take place you need technology that’s able to turn sign language into voice or text, and voice into text or sign language — and to do all of this in real-time.

That’s what a Dallas-based startup called KinTrans has developed, with a 3D camera and accompanying microphone that’s able to determine what is being said or signed, and then translate it quickly and accurately for the other party.

According to its creators, the system is already able to recognize thousands of signed words with an accuracy of around 98 percent. It can handle multiple languages, too.

Smart gloves

Smart Glove UCSD LOG

Don’t like the idea of being watched by a camera? No problem. At the University of California San Diego, researchers have developed low-cost smart gloves able to automatically translate American Sign Language (ASL) into digital text which appears on a corresponding computer or smartphone. No camera required.

To use the glove, the wearer simply signs out letters in the ASL alphabet, which are then recognized due to variances in electrical resistance. Like Project Aslan, one of the best features of this solution is its low price point, making it a potentially affordable solution to a challenging problem. The components in the smart glove add up to less than $100 in cost.

While it’s still a research project for now, we can imagine that price coming down further with mass production.

Next-gen transcription technology

SpeakSee Crowdfunding Video

Thanks to advances in speech recognition, speech-to-text technology has been getting better for years. But it’s not always useful for situations in which there are multiple people speaking, such as in a group conversation setting.

A new Indiegogo campaign called SpeakSee, created by Netherlands-based entrepreneurs, uses individual clip-on microphones and beamforming technology to isolate specific people’s speech and filter out any background noise.

As a result, conversations are transformed into script-like transcripts, in which different speakers are highlighted in unique colors. These can then be read on an accompanying tablet or smartphone.

Brainwave-reading hearing aid

Cognitive Hearing Aid

Imagine if a hearing aid was able to work out what sound you’re trying to focus on and magnify just that audio, while quietening down everything else.

That’s what researchers from Columbia University School of Engineering and Applied Science have been working on with a new “cognitive hearing aid,” designed to help wearers in situations like crowded rooms.

The device works by monitoring the brain activity of users, and then using a deep neural network to figure out which speaker’s voice the listener is concentrating on. Right now, it’s still a research project, but this could be transformative if and when it eventually arrives on the market.

Solar ears

Solar Ear - Tendekayi Katsiga - A Solar Powered Solution for the Hearing Impaired

There are close to 400 million people worldwide with a hearing loss-related disability. Of these, more than half live in countries with lower levels of income to places like the United States. That’s a problem when it comes to hearing aids, since the cost of the devices and their batteries can be out of reach for many people they would otherwise be able to help.

As its name implies, Solar Ear is a solar-powered hearing aid, whose batteries are designed to last 2-3 years, compared with the 7-10 days of a common battery. It’s considerably cheaper than regular hearing aids, too.

Translating hearing aids

Time2Translate Translation Smartwatch being used in China

Hearing aids allow users who are deaf or hard of hearing to have other people’s voices piped directly into their ear. But what if it could perform a bit of computational magic along the way, and use machine translation to, say, transform a native German speaker’s words into English? That’s technology that will certainly find itself into high-end hearing aids over the next several years.

Already there have been some pretty impressive demos in the form of Waverly Labs’ Pilot Translating Earpiece and the IBM Watson-powered TranslateOne2One. De repente, los audífonos están a punto de ser mucho más útiles. (Suddenly, hearing aids are about to get a whole lot more useful.)

Hearing through your… skin?

David Eagleman, Ph.D: Biological Limits of Human Perception

Most hearing aids are, in our experience, overwhelmingly ear-based. A research project from neuroscientists at Baylor College of Medicine in Houston, Texas, wants to change that with the help of a vest which allows deaf people to “hear” through their skin.

The device collects incoming audio via the users’ smartphone and then translates this into specific vibrations the wearer can feel on their skin. The hope is that, over time, users will learn to process these vibrations as information in much the same way that a blind person could learn to read via the tactile bumps of braille.

As far as we’re aware, this is an ongoing research project, but a Kickstarter campaign a few years ago suggests that the goal is to develop a commercial product at the end of it.

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more
AI turned Breaking Bad into an anime — and it’s terrifying
Split image of Breaking Bad anime characters.

These days, it seems like there's nothing AI programs can't do. Thanks to advancements in artificial intelligence, deepfakes have done digital "face-offs" with Hollywood celebrities in films and TV shows, VFX artists can de-age actors almost instantly, and ChatGPT has learned how to write big-budget screenplays in the blink of an eye. Pretty soon, AI will probably decide who wins at the Oscars.

Within the past year, AI has also been used to generate beautiful works of art in seconds, creating a viral new trend and causing a boon for fan artists everywhere. TikTok user @cyborgism recently broke the internet by posting a clip featuring many AI-generated pictures of Breaking Bad. The theme here is that the characters are depicted as anime characters straight out of the 1980s, and the result is concerning to say the least. Depending on your viewpoint, Breaking Bad AI (my unofficial name for it) shows how technology can either threaten the integrity of original works of art or nurture artistic expression.
What if AI created Breaking Bad as a 1980s anime?
Playing over Metro Boomin's rap remix of the famous "I am the one who knocks" monologue, the video features images of the cast that range from shockingly realistic to full-on exaggerated. The clip currently has over 65,000 likes on TikTok alone, and many other users have shared their thoughts on the art. One user wrote, "Regardless of the repercussions on the entertainment industry, I can't wait for AI to be advanced enough to animate the whole show like this."

Read more