Skip to main content

U.S. studies new facial recognition tech built with masked faces in mind

The pandemic has proved facial recognition systems such as Apple’s Face ID are not built to recognize people under masks. Now, the National Institute of Standards and Technology, a government body responsible for accessing such systems, has backed it with more conclusive evidence and says it’s now exploring new models that are designed to handle masked faces.

In its latest study, the NIST has revealed that masks can significantly thwart facial recognition algorithms’ accuracy and raise the error rate to as much as 50% — even in the case of some of the best and widely used commercial platforms. The report adds that the systems performed worse when the mask was black in color and was worn higher up the nose area.

Recommended Videos

“With the arrival of the pandemic, we need to understand how face recognition technology deals with masked faces,” NIST computer scientist Mei Ngan in the report. “We have begun by focusing on how an algorithm developed before the pandemic might be affected by subjects wearing face masks.”

Unlike the controversial facial recognition systems that are being employed, for instance, to identify protesters, this NIST study focuses on one-to-one algorithms that try to match two photos of the same person. Such systems can be generally found at immigration checkpoints for passport verification or on modern phones.

Ngan adds that the team, for its next round of studies, is now examining new facial recognition tech that is engineered with masked faces in mind and one-to-many searches. “Later this summer, we plan to test the accuracy of algorithms that were intentionally developed with masked faces in mind,” she added.

Masked faces have been a topic of concern for federal agencies that depend on facial recognition tech. In a recent internal bulletin (via The Intercept), the U.S. Department of Homeland Security expressed worry over “potential impacts that widespread use of protective masks could have on security operations that incorporate face recognition systems.” Notably, the NIST study was drafted in collaboration with the Department of Homeland Security’s Science and Technology Directorate, and Customs and Border Protection.

However, the rampant use of facial recognition systems across the United States and the growth of controversial startups such as Clearview A.I. has faced pushback from both privacy advocates and tech giants. Over the last few months, several companies such as Microsoft and IBM have pledged to not invest facial recognition systems entirely.

Shubham Agarwal
Former Digital Trends Contributor
Shubham Agarwal is a freelance technology journalist from Ahmedabad, India. His work has previously appeared in Firstpost…
Motorola’s new Moto Edge coming to the U.S. in September
Motorola Edge design close up.

Weeks after announcing the Motorola Edge 20 series for international markets, Motorola has unveiled a new phone from the lineup for the U.S. market: The new Motorola Edge. The Moto Edge is an upper midrange, verging on flagship phone from Motorola, a brand typically known for budget devices, though it has had some noteworthy flagships. Reviewers liked the previous generation of the phone, but saw room for improvement in camera performance and software -- and Motorola seems to have delivered.

According to Motorola, the new Edge has better image quality than its predecessor. The triple camera system includes a 108-megapixel (MP) main camera, an 8MP wide-angle (119-degree) lens with Macro Vision, and a 2MP depth sensor. The setup is ideal for fitting more scenes into the frame, zooming in for extreme close-ups of subjects like food and flowers, and blurring the background for more professional-looking portraits.

Read more
Facial recognition tech for bears aims to keep humans safe
A brown bear in Hokkaido, Japan.

If bears could talk, they might voice privacy concerns. But their current inability to articulate thoughts means there isn’t much they can do about plans in Japan to use facial recognition to identify so-called "troublemakers" among its community.

With bears increasingly venturing into urban areas across Japan, and the number of bear attacks on the rise, the town of Shibetsu in the country’s northern prefecture of Hokkaido is hoping that artificial intelligence will help it to better manage the situation and keep people safe, the Mainichi Shimbun reported.

Read more
Jaybird’s new Vista 2 wireless earbuds are tough enough for the U.S. military
Jaybird Vista 2 earbuds in palm with water pouring.

Many brands claim that their headphones are catered to consumers who are "on the go," but usually this sort of language refers more to going to the coffee shop for a latte than, say, going on a trek through the Andes. Jaybird, however, is more interested in the latter, and its newest pair of true wireless earbuds is designed to be your companion through even the most extreme of journeys.

When Jaybird says that the Vista 2 True Wireless Sport Earbuds are built for athletes and adventurers, they mean it. To begin with, the company claims to have pioneered a "signature fit" to help the earbuds stay in your ears while climbing, running, biking, etc. They also come with three sizes of interchangeable "eargels" that, Jaybird claims, will make you forget that they're even in your ears. Fit is enormously important with active headphones, and when we reviewed the Vista 2's predecessors -- the Jaybird Vista -- we found they delivered in that department.

Read more