Skip to main content

Gesture-recognition system can translate sign language into text — and back again

KinTrans Inclusive Communication Inclusive Community
Voice-based dictation tools may be old news from in terms of technology, but not everyone is able to fully take advantage of them. For deaf people who use signing as their primary means of communication, available options are far more limited. That’s even more frustrating when you consider the challenges that may confront a person trying to converse with folks who are not proficient in signing.

A Dallas-based startup is setting out to set things right, though. Called KinTrans, the team has developed smart tech capable of translating sign language into voice and text, and voice taken to text or sign language automatically.

Recommended Videos

The results allow signers and non-signers to communicate together in their own languages, effectively, effortlessly, and instantaneously.

“What makes this technology exciting is the ability to open up conversations between signers and speakers in the marketplace, workplace, schools, health care, and civic centers,” Catherine Bentley, cofounder and business development officer at KinTrans, told Digital Trends. “Traditionally, communicating in these settings has been difficult; requiring friends or family who sign and interpret, or professional interpreters on-site or off-site through video, and even using pen and paper. None of these dependencies are scalable — plus they lack privacy and independence for the signer.”

KinTrans’ tech relies on a 3D camera which tracks the movement of a signer’s hands and body when they sign out words. When requested, it can then translate the signed words into written English (or, currently, Arabic, although additional languages will follow in the future). Alternatively, voice can be translated into signed words communicated by an animated avatar on the screen. According to its creators, the system is already able to recognize thousands of signed words with an accuracy of around 98 percent.

At present, Bentley said that a beta version has been rolled out, and is being used in a variety of service and point-of-sale environments. This is available in both American Sign Language and Arabic Union Sign Language.

“As KinTrans grows, other uses and applications will be developed so that it becomes a standard deaf communication platform, hosting millions of conversations in a variety of public and private settings, online and offline,” she said.

Sign us up!

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Mazda confirms a hybrid CX-5 and electric SUV are on the way
mazda hybrid cx 5 electric suv 2024 arata concept 4

Mazda might be making headway in the pursuit of bringing back an electric vehicle (EV) stateside.

Ever since it discontinued the MX-30 EV in the U.S. last year, the Japanese automaker has had zero EV offerings for potential U.S. customers.

Read more
Range Rover’s first electric SUV has 48,000 pre-orders
Land Rover Range Rover Velar SVAutobiography Dynamic Edition

Range Rover, the brand made famous for its British-styled, luxury, all-terrain SUVs, is keen to show it means business about going electric.

And, according to the most recent investor presentation by parent company JLR, that’s all because Range Rover fans are showing the way. Not only was demand for Range Rover’s hybrid vehicles up 29% in the last six months, but customers are buying hybrids “as a stepping stone towards battery electric vehicles,” the company says.

Read more
BYD’s cheap EVs might remain out of Canada too
BYD Han

With Chinese-made electric vehicles facing stiff tariffs in both Europe and America, a stirring question for EV drivers has started to arise: Can the race to make EVs more affordable continue if the world leader is kept out of the race?

China’s BYD, recognized as a global leader in terms of affordability, had to backtrack on plans to reach the U.S. market after the Biden administration in May imposed 100% tariffs on EVs made in China.

Read more