Skip to main content

Mindmaze's VR facial-tracking system may make an appearance during the holidays

mindmaze mask facial tracking vr holidays
Image used with permission by copyright holder
While Bebop Sensors is serving up gloves to virtual and augmented reality headset makers that track hands and fingers, Mindmaze is working on technology to correctly track facial expressions. Simply called Mask, it sits between the user’s face and the virtual reality headset and will be compatible with the HTC Vive, the Oculus Rift, and Samsung’s Gear VR headsets when it possibly launches at the end of 2017.

Mask is comprised of eight, low-cost electrodes mounted within the foam padding of a VR headset. These electrodes detect the electrical impulses of the face, analyzes them via advanced machine learning, and replicates the facial movements on a virtual avatar. This tech supposedly detects expressions 20 to 30 milliseconds before they even physically appear on your face.

Recommended Videos

However, Mindmaze will not sell Mask directly to users. Instead, it will be sold to headset makers to implement into their own retail kits. Because Mask is a very low-cost solution, the cost of VR headset kits will not see a dramatic price increase.  The big cost on Mindmaze’s part was creating software that could understand the data generated by those eight electrodes.

Please enable Javascript to view this content

According to Mindmaze CEO Tej Tadi, a computer receiving the eight streams of data registers the rise and fall of each signal like an EKG. Thus, MindMaze had to utilize its neurotech expertise to create an algorithm — a set of rules for calculating a problem or situation — to read the data and pull information to form a set of facial expressions.

“When I strapped on the headset to try Mask for myself, even without any calibration, a range of canned expressions that I made were quickly reflected on the face of an avatar that represented me in the virtual world,” reports Ben Lang from Road to VR. “When I smiled, it smiled. When I frowned, it frowned. It was easily the best calibration-free tech that I’ve seen of this sort.”

That is good news coming from a hands-on experience with a prototype. Lang said this model only supported 10 different facial expressions. On top of that, facial movements were sterile, meaning Mask did not render all the small little facial details that make your expressions unique. Eventually, the team will add more facial expressions along with low-key eye tracking to express basic eye movements.

That said, Mask is still in the prototype stage. The model Lang tested tended to render facial expressions incorrectly and had trouble picking up normal blinking. But that is where machine learning comes in: The algorithm will get smarter over time, making for a more “robust” experience as it understands the facial movements of each user.

While all of this sounds like a lot of computing power, Tadi said that the workload is low enough for the system to run on smartphone-based VR headsets. That is due to the electrode/algorithm combo, which is a stark contrast to the camera-based facial tracking approach on PC.

So when will Mask be ready? There is a good chance it will be integrated into VR headsets by the 2017 holiday season or shortly thereafter.

Kevin Parrish
Former Digital Trends Contributor
Kevin started taking PCs apart in the 90s when Quake was on the way and his PC lacked the required components. Since then…
Upgrade your gaming PC with 32GB Corsair RAM for under $100
The Corsair Vengeance RGB DDR5 RAM on a white background.

Gamers who prefer building a PC from scratch over buying from gaming PC deals need to make sure that they've got good components. If you haven't purchased RAM yet, you may want to take advantage of Newegg's offer for the 32GB Corsair Vengeance RGB DDR5 RAM. From its original price of $150, it's down to just $98 following a 34% discount. That's $52 in savings on one of the most important parts for your gaming desktop, but you're going to have to hurry because we don't think the savings will remain available for long.

Why you should buy the 32GB Corsair Vengeance RGB DDR5 RAM
For a gaming PC that won't have trouble running the best PC games, you'll need the 32GB Corsair Vengeance RGB DDR5 RAM, as our guide on how much RAM do you need says 32GB is the sweet spot for high-end gamers. In our DDR5 RAM versus DDR4 RAM comparison, we highlighted the benefits of DDR5 RAM, which include faster performance as the new standard. DDR5 runs hotter than DDR4 though, so you'll need to have compatible heat sinks and a proper cooling system for your gaming PC if you'll equip it with the 32GB Corsair Vengeance RGB DDR5 RAM.

Read more
Newegg is selling a prebuilt gaming PC with RTX 4060 for $800
The ABS Cyclone Aqua gaming PC on a white background.

You don't need to spend more than $1,000 to get a dependable machine from gaming PC deals. You just need to be patient in looking for incredible offers like this one from Newegg: the ABS Cyclone Aqua for only $800, following a $200 discount on its sticker price of $1,000. This gaming desktop won't stay available at 20% off for long though, so if you're interested, we highly recommend adding it to your cart and completing the checkout process as soon as possible.

Why you should buy the ABS Cyclone Aqua gaming PC
The ABS Cyclone Aqua will let you play the best PC games without any issues, as it's powered by the 13th-generation Intel Core i5 processor and the Zotac Gaming GeForce RTX 4060 graphics card, alongside 32GB of RAM that's plenty for most gamers, according to our guide on how to buy a gaming desktop. You'll also get a 1TB SSD with this gaming PC, so you'll have lots of space to install your favorite titles and all their DLCs, and with Windows 11 Home pre-loaded, you can start doing that right away after hooking up the ABS Cyclone Aqua to the necessary peripherals.

Read more
With 400 million users, OpenAI maintains lead in competitive AI landscape
OpenAI's new typeface OpenAI Sans

Competition in the AI industry remains tough, and OpenAI has proven that it is not taking any coming challenges lightly. The generative AI brand announced Thursday that it services 400 million weekly active users as of February, a 33% increase in less than three months.

OpenAI chief operating officer, Brad Lightcap confirmed the latest user statistics to CNBC, indicating that the figures had not been previously reported. The numbers have quickly risen from previously confirmed stats of 300 million weekly users in December.

Read more