Skip to main content

The incredible underlying technology of Snapchat’s selfie lenses

snapchat selfie lens computer vision technology daven mathies
Daven Mathies / Digital Trends
Snapchat’s selfie lenses, more commonly referred to as filters, are fun, ridiculous, and good for a cheap laugh. Thanks to facial recognition, selfie lenses can do things like transmogrify your boring ol’ mug into a cute puppy or shoot rainbows out of your mouth. It’s a novelty that wears off quickly, so Snapchat continually introduces new lenses to keep the experience fresh.

But for a feature that exists as little more than a gimmick, there’s a surprising amount of underlying technology powering it.

Recommended Videos

As reported by PetaPixel, the facial recognition engine that makes Snapchat lenses possible was acquired by the company when it purchased Looksery, a Ukrainian computer vision startup. Computer vision is a buzzy phrase these days, with wide ranging applications from depositing a check with your phone to, well, facial recognition. But, as the video below from Vox explains, Snapchat’s lenses have to do much more than simply recognize a face; they also have to model it in 3D space, taking into account rotation and even occlusion so that overlaid props and effects can animate correctly in video.

How Snapchat's filters work

While the technology itself isn’t new, the ability to apply it in real-time from a mobile device is. As smartphones continue to gain processing power, Snapchat will be able to introduce increasingly complex lenses — and the company has a lot of money riding on them.

Please enable Javascript to view this content

Snapchat purchased Looksery for a staggering $150 million in 2015 and just this year bought another computer vision startup, Seene. Snapchat clearly sees an advertising opportunity with its selfie lenses, and began introducing sponsored lenses last year, for which it apparently charges no small fee, according to TechCrunch.

As impressive as the technology is, the Vox video ends on a note of caution when it comes to facial recognition and privacy. Currently, both government agencies and private companies like Facebook are storing huge databases of faces linked to real names, and there’s nothing to legally prevent them from doing so.

Making yourself look like a pirate in a Snapchat selfie is probably harmless, though.

Daven Mathies
Former Digital Trends Contributor
Daven is a contributing writer to the photography section. He has been with Digital Trends since 2016 and has been writing…
How to go live on TikTok (and can you with under 1,000 followers?)
Tik Tok

It only takes a few steps to go live on TikTok and broadcast yourself to the world:

Touch the + button at the bottom of the screen.
Press the Live option under the record button.
Come up with a title for your live stream. 
Click Go Live to begin.

Read more
Acer’s new gaming laptop bring Nvidia RTX 40-series GPUs under $1,000
Two Acer gaming laptops over a dark blue background.

You can find Nvidia's RTX 40-series graphics cards in some of the best gaming laptops, but the downside is that they're all expensive, if not overpriced. Previously, that meant you'd be forced to choose between getting something affordable or getting access to Nvidia's GPU cheat code -- DLSS 3. Now, there's finally some hope on the horizon, as Acer is launching a budget-friendly laptop that can still run modern games. We're talking about the Acer Nitro V 15.

The new laptop will be available in a few different configurations, each equipped with Intel's latest 13th-Gen CPUs, including either Core i5 or Core i7 models. All of them also come with a 15.6-inch 144Hz display. While every configuration also features a Nvidia graphics card, not all of those GPUs are equally thrilling. The cheapest model, priced at $700, features a Core i5-13420H CPU and an RTX 2050 GPU. This comes paired with just 8GB of RAM and a 512GB SSD.

Read more
Watch this incredible slow-motion footage of a rocket engine test
A screenshot from the Slo Mo Guys' footage of a rocket engine test.

Close-up Ignition of a Rocket Engine in Slow Mo - The Slow Mo Guys

The Slow Mo guys -- aka Gavin Free and Daniel Gruchy -- are back with another video that’s as fascinating as it is entertaining, this one showing a rocket engine test in astonishing, slowed down, detail.

Read more