Skip to main content

Google can catch shoulder surfers peeking at your phone

google shoulder surfers smartphone alert shopping cafe
Image used with permission by copyright holder
Imagine you’re in town waiting for a friend. With time to kill before they arrive, you do what most people do and get your smartphone out. You might flick through your Twitter timeline, check Facebook, open Instagram, or tap out a message on WhatsApp. You fail to notice the stranger standing right behind you, looking at your display.

Would you like your phone to be able flag such an occurrence with an on-screen message along the lines of, “There’s someone else looking at your display,” or perhaps something more direct, like, “Hey! Stop looking at my phone right now, creep!” though such harsh words may admittedly cause an unwanted public altercation.

Recommended Videos

It turns out that researchers at Google have been developing such a privacy-focused feature, and have now posted a video demonstrating how it works.

Please enable Javascript to view this content

The feature uses the front-facing camera to scan the faces of anyone looking toward the phone. If the software spots someone it doesn’t recognize, it flashes up the message: “Stranger is looking alert!”

In Google’s recently posted demonstration video (below) spotted by Quartz, the researchers have had a bit of fun by adding a stream of Snapchat-inspired rainbow-colored vomit coming from the stranger’s mouth.

NIPS 2017 Accompaniment Demo Video

According to the video’s introduction, it seems like this may be more of an experimental project, or possibly the seed of an idea that could one day be offered as an option on our phones.

The feature is set to be presented at next week’s Neural Information Processing Systems conference in Long Beach, California, by Google researchers Hee Jung Ryu and Florian Schroff.

The technology can work for a range of “lighting conditions and head poses,” according to the researchers’ notes, and recognizes a face in two milliseconds, so you’ll know pretty darn quick if someone is peering over your shoulder.

A feature like this would come in handy if you’re in a busy place and you’re reading or writing personal messages, or if you’d simply prefer to keep your smartphone display to yourself.

It might work better in some situations than others, though. On a crowded train, for example, a fellow passenger may just glance at your screen simply because it’s human nature to do so. That could result in the alert popping up with annoying regularity, in which case it would prove more useful if it showed after a few seconds once the technology determined that the shoulder surfer is taking a long, lingering look rather than a fleeting one.

With facial recognition technology already well developed and front-facing camera technology improving all the time, we imagine such a feature could be added to most smartphones with little effort, though whether shoulder surfing is enough of a problem that users would find it useful is another question entirely.

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
The Google Pixel 9 may soon get a powerful phone call feature
Someone holding the Google Pixel 9 Pro XL, showing the back of the phone.

With the Google Pixel 9 series, Google offers a feature called Call Notes in the Google Phone app. Powered by Gemini Nano, the feature automatically generates call summaries and captures points discussed. Thanks to artificial intelligence, that feature could soon be expanded.

According to Android Authority, an APK teardown has revealed code indicating that a new feature called “Call To-do List” may soon be available on supported devices. The code strings link “Call To-do List” to “Fermat,” the code name for the Call Notes feature.

Read more
Your Google Photos app is about to look different. Here’s what’s changing
The Google Photos app on the Google Pixel 9 Pro Fold.

Google is implementing a small yet significant change to its popular Google Photos app. As first noted by 9to5Google, the app's "Memories" tab is being removed. Memories is an auto-organizing, scrapbook-like feature that utilizes artificial intelligence to create an AI-powered feed.

Since its release, the Memories tab has been in the bottom bar of the Google Photos app. The Memories tab is being replaced by Moments, which will reside inside the app's Collections tab. This is where you can find People & pets, Albums, Documents, and Places.

Read more
You can now send higher-quality photos in RCS Google Messages chats. Here’s how
Google Messages app on a Pixel 8 Pro, showing an RCS Chat message thread.

Google Messages is one of the most popular messaging platforms on the planet — so popular, in fact, that companies like Samsung and Verizon are doing away with their in-house messaging apps in favor of it. More than 1 billion users engage with Google Messages monthly, and a large part of the experience is RCS. We've been eagerly looking forward to the introduction of quality control when sending photos, a feature first spotted earlier this month.

Now, Google Messages has begun rolling out the "original quality" media-sharing feature, as noted by Android Authority. For now, it's only available in the beta, but that's a firm sign that all users will be receiving it shortly.

Read more