Skip to main content

Mindmaze's VR facial-tracking system may make an appearance during the holidays

mindmaze mask facial tracking vr holidays
Image used with permission by copyright holder
While Bebop Sensors is serving up gloves to virtual and augmented reality headset makers that track hands and fingers, Mindmaze is working on technology to correctly track facial expressions. Simply called Mask, it sits between the user’s face and the virtual reality headset and will be compatible with the HTC Vive, the Oculus Rift, and Samsung’s Gear VR headsets when it possibly launches at the end of 2017.

Mask is comprised of eight, low-cost electrodes mounted within the foam padding of a VR headset. These electrodes detect the electrical impulses of the face, analyzes them via advanced machine learning, and replicates the facial movements on a virtual avatar. This tech supposedly detects expressions 20 to 30 milliseconds before they even physically appear on your face.

Recommended Videos

However, Mindmaze will not sell Mask directly to users. Instead, it will be sold to headset makers to implement into their own retail kits. Because Mask is a very low-cost solution, the cost of VR headset kits will not see a dramatic price increase.  The big cost on Mindmaze’s part was creating software that could understand the data generated by those eight electrodes.

Please enable Javascript to view this content

According to Mindmaze CEO Tej Tadi, a computer receiving the eight streams of data registers the rise and fall of each signal like an EKG. Thus, MindMaze had to utilize its neurotech expertise to create an algorithm — a set of rules for calculating a problem or situation — to read the data and pull information to form a set of facial expressions.

“When I strapped on the headset to try Mask for myself, even without any calibration, a range of canned expressions that I made were quickly reflected on the face of an avatar that represented me in the virtual world,” reports Ben Lang from Road to VR. “When I smiled, it smiled. When I frowned, it frowned. It was easily the best calibration-free tech that I’ve seen of this sort.”

That is good news coming from a hands-on experience with a prototype. Lang said this model only supported 10 different facial expressions. On top of that, facial movements were sterile, meaning Mask did not render all the small little facial details that make your expressions unique. Eventually, the team will add more facial expressions along with low-key eye tracking to express basic eye movements.

That said, Mask is still in the prototype stage. The model Lang tested tended to render facial expressions incorrectly and had trouble picking up normal blinking. But that is where machine learning comes in: The algorithm will get smarter over time, making for a more “robust” experience as it understands the facial movements of each user.

While all of this sounds like a lot of computing power, Tadi said that the workload is low enough for the system to run on smartphone-based VR headsets. That is due to the electrode/algorithm combo, which is a stark contrast to the camera-based facial tracking approach on PC.

So when will Mask be ready? There is a good chance it will be integrated into VR headsets by the 2017 holiday season or shortly thereafter.

Kevin Parrish
Former Digital Trends Contributor
Kevin started taking PCs apart in the 90s when Quake was on the way and his PC lacked the required components. Since then…
ChatGPT just got a bump to its coding powers
ChatGPT collaborating with Notion

For its penultimate 12 Days of OpenAI announcement, the company revealed a trio of updates to ChatGPT's app integration on Thursday, which should make using the AI in conjunction with other programs on your desktop less of a chore.

OpenAI unveiled ChatGPT's ability to collaborate with select developer-focused macOS apps, specifically VS Code, Xcode, TextEdit, Terminal, and iTerm2, back in November. Rather than needing to copy and paste code into ChatGPT, this feature allows the chatbot to pull specified content from the coding app as you enter your text prompt. ChatGPT, however, cannot generate code directly into the app, as Cursor or GitHub Copilot are able to.

Read more
Here’s why some PC gamers shouldn’t install the latest Windows 11 update
Overwatch 2 running on the LG OLED 27 gaming monitor.

The latest Windows 11 update, codenamed 24H2, has been a troubled rollout for Microsoft, but one thing's been clear from the beginning: PC gamers should wait to install it. Let's add another issue to the list, shall we?

As spotted by Windows Latest, Microsoft has confirmed in an update to its Windows 11 24H2 problems page, that Windows 11 24H2 is causing issues with its Auto HDR feature. The result of the bug is that incorrect colors are being displayed or, even worse, are breaking games entirely and causing them to not be responsive.

Read more
Someone just got the Intel B570 GPU a month in advance — and it works
ASRock's Arc B570 Challenger GPU.

Although Intel's Arc B580 is already here, the B570 is only set to launch on January 16. However, a German retailer listed the card well ahead of time and, surprisingly, one B570 actually shipped to a customer. The B580 is one of the best graphics cards for budget-conscious gamers, but how will the B570 compare?

Early listings and preorders happen shockingly often. For example, yesterday we found an RTX 5090 PC priced at well over $6,000. However, those listings often don't amount to much, and the items don't ship until their designated release dates -- but not this time.

Read more