Skip to main content

Nuance's Nina virtual assistant gets better with time, and a little human help

nuance nina assistant sddefault resized  1
Image used with permission by copyright holder
You might know Nuance, the natural voice and AI lab headquartered on the outskirts of Boston, from its popular Dragon NautrallySpeaking transcription software for PC. But what you might not know is that the firm’s conversational AI, which powers the customer service platforms of 6,500 companies around the globe, handles billions of transactions every year. And it is now capable of more.

On Thursday, Nuance launched a new version of Nina, its AI-powered, cross-platform assistant melding of machine smarts and human intelligence. From a customer perspective, it is just like any other AI-powered voice assistant — Nina can respond to questions (think the status of a pizza order, for example) and walk you through a conscripted list of choices. But unlike Apple’s Siri, Amazon’s Alexa, and Microsoft’s Cortana, Nina is sharp enough to know when it can’t answer a question — and to throw it to a human specialist who can.

Recommended Videos

“The advantage of AI is, they’re always available,” Robert Weiderman, Nuance’s executive vice president and general manager, told Digital Trends. “Unlike a human, they never have a bad night — you can self-service 24/7.”

Amazon Echo deal
Image used with permission by copyright holder

Here’s how it works: Nuance’s data engineers use Nina Coach, an automated learning tool, to train it on a business’ ins and outs. Once it has gotten a handle on the basics, it goes to work, fielding between 80 to 90 percent of customer calls, SMS messages, and texts from chat platforms like Facebook Messenger.

“General-purpose assistants like Alexa and Siri know a little about a lot,” Weiderman said. “Nina can go deep.”

When Nina is unsure about a question, it will consult help — human help. In those rare cases, Nuance’s AI tries to match customers to reps with relevant expertise. Then, it provides those reps with a transcript and history of the conversation, and a list of likely answers in order of confidence. The call center staffer’s choice is recorded, analyzed, and folded back into what Weiderman calls the “semantic brain” — Nina’s collective intelligence.

“It’s just like people,” Weiderman said. “Kids learn to have conversations, go to high school and college, get a doctorate, and become an expert in something. Nina’s the same way — it has a learning loop will eventually create 100 percent confident answers.”

Image used with permission by copyright holder

Weiderman sees it as a way to free up hands in customer support centers, and to help businesses prioritize the most important — and difficult — requests without impacting other customers’ experience. With Nuance’s infrastructure up and running, call center agents can service three to six customers at a time, Weiderman said.

“You can turn on support for messaging, but you can’t control the volume that’s going to come at you,” he said. “The days when company’s could control how consumers spoke with them is going away. First the web came along, and you could call or go to the website. And now there’s chat apps like Facebook Messenger, Line, and Kik, and Internet of Things devices like Amazon’s Echo.”

“Nina’s able to support a growing number of channels, including voice, mobile and Internet of Things devices like Alexa,” he said.

Human-augmented intelligence is just the tip of Nina’s iceberg. Nuance also announced asynchronous messaging, which lets customers start a conversation with a business’s assistant on one platform and pick it up later, on another. You can text a credit card company about an erroneous charge via Facebook Messenger, for example, and get status updates via SMS every hour until the problem is resolved.

Nina’s also gaining the ability to transition customers to digital channels. If you call a company’s support center and Nuance’s automated system can’t find the answer to your question, you’ll get two options: Wait for a human agent, or continue the conversation on a digital channel like Facebook Messenger.

“We don’t expect text message conversations to be instantaneous,” Weiderman said. “And when you’re dealing with something like an insurance claim, it can take days of back and forth to get the paperwork in order.”

Nuance rolled out the new Nina features to ICBC Bank, one of the largest in China, in 2012. More than a billion users interact with its support via messaging app WeChat, Weiderman said, accounting for 85 percent of all customer service requests.

“We’re adding cognitive, data-driven machine learning to our products,” Weiderman said. “We’re the only vendor combining the tooling, intelligence, and analytics of natural language processing and cognitive technologies […] to deliver automated and assisted solutions targeted to enterprise needs.

Kyle Wiggers
Former Digital Trends Contributor
Kyle Wiggers is a writer, Web designer, and podcaster with an acute interest in all things tech. When not reviewing gadgets…
Google just announced Android 16. Here’s everything new
The Android 16 logo on a smartphone, resting on a shelf.

No, that headline isn't a typo. A little over a month after Android 15 was released to the masses in October, Google has already announced Android 16 and begun rolling out its first developer beta of the newest Android version.

If this seems like a much earlier release than usual, that's because it is. We typically expect the first developer beta of the next Android update to arrive in February. For Android 16, however, Google has pushed the timeline up by a few months and launched Android 16 Developer Preview 1 in mid-November.
Why Android 16 is launching so much earlier

Read more
Here’s every Pixel phone that can download Android 16 Developer Preview 1
The Google Pixel 9 Pro XL next to the Google Pixel 8 Pro.

Even though Android 15 launched only recently, Google is already moving on to Android 16, which is much earlier than is typical. And if you have a Pixel device from the past couple of years, you can get the Android 16 Developer Preview 1 right now.

Typically, when Google releases a beta for Android, the Pixel lineup gets it first before any other phones. When Google announced Android 16 earlier today, we didn’t know exactly which Pixel models would be able to get the Developer Preview. But Google just revealed which models can run Android 16, and two of them are a bit surprising.

Read more
Save $45 on the Amazfit T-Rex 3 smartwatch during this early Black Friday sale
Amazfit T-Rex 3 smartwatch used while surfing

If you love the great outdoors and big adventures, you already know that you need rugged equipment to keep up. Anything fragile or testy will break down easily when subjected to the elements. Something like a smartwatch, for example, needs to be tough, water-resistant, and ready to take on the world. Allow me to introduce the Amazfit T-Rex 3 smartwatch, built from the ground up figuratively for the outdoors. Able to withstand temperatures from 158 degrees Fahrenheit down to negative 22 degrees Fahrenheit, this beast of a machine will definitely keep up. It's also on sale right now for Black Friday. Normally $280, it's yours for just $235 -- saving you $45. That deal is only good until November 27, however, so don't wait too long if you're interested.
Shop Now
 
Why shop this Black Friday deal on the Amazfit T-Rex 3 smartwatch

If you want a solid, in-depth look at the watch, be sure to check out Andy Boxall's hands-on with the Amazfit T-Rex 3. He agrees it's rough, tough, and capable, and even ditched his Apple Watch for it. He also praises the watch for its intelligent design, solid functionality, and accessible price. Speaking of accessible price, with this Black Friday deal Amazfit is offering the T-Rex 3 smartwatch is more affordable than ever. It shaves $45 off the regular price, bringing it down to a reasonable $235.

Read more