Skip to main content

eBay HeadGaze app lets physically impaired control iPhone X with head movements

Image used with permission by copyright holder

Accessibility options for the physically impaired just got a huge boost, thanks to eBay’s open-source release of its HeadGaze software that allows users to control an iPhone X with simple head movements.

The software only works on the iPhone X at the moment, and uses the phone’s revolutionary FaceID system to track the user’s head movements, and translate them directly onto the screen. The software creates an on-screen cursor that’s then controlled by the user’s movements. Triggering a button or keypress is done by lingering the cursor over the desired button, and users can scroll or turn pages by lingering the cursor on specific parts of the screen. It’s a control scheme that won’t be unfamiliar to anyone who’s used a phone-based virtual reality headset like the Gear VR — but with the added benefit of not needing a bulky headset.

The technology was created by eBay’s computer team with guidance from PhD candidate and eBay intern Muratcan Cicek. While the software hasn’t yet been released on eBay’s app, eBay has released a video that shows the software working on the app. In an altruistic move, the auction giant has also released the source code on GitHub, so other developers can benefit from the software.

The software is primarily aimed at increasing accessibility options for the physically impaired. It is hoped this software could be incorporated into future mobile operating systems, giving more options to those who may struggle with the touch-based systems currently used in most mobile phones. With a system like HeadGaze, a phone could be held in position while a user uses head movements to browse. Future improvements in voice-based A.I. could also play a role in these accessibility options, helping to open the world of tech to a larger community of people.

Speaking to VentureBeat, Cicek said that the team is working on incorporating other movements into the system, including tracking eye movement. He also pointed out the uses this technology could have beyond the options it offers for the physically impaired, with examples from everyday life.

“Tired of trying to scroll through a recipe on your phone screen with greasy fingers while cooking? Too messy to follow the how-to manual on your cell phone while you’re tinkering with the car engine under the hood? Too cold to remove your gloves to use your phone?”

While touchscreens are likely going nowhere for a while yet, it’s likely we’ll see some serious developments in this area within the next few years. After all, a lot of us can unlock our phone with our eyes — why not control it with them, too?

Editors' Recommendations

Mark Jansen
Mark Jansen is an avid follower of everything that beeps, bloops, or makes pretty lights. He has a degree in Ancient &…
This is the iPhone concept of my dreams
iPhone concept mimicking iPad Pro desgn.

It’s an odd day to be talking about iPhone design. Yesterday, Apple delivered what can be called the pinnacle of tablet aesthetics with the 2024 iPad Pro, which is even slimmer than the iPod Nano. Today, Bloomberg reports that Duncan Kerr -- a design executive from the legendary Jony Ive group and was a key figure behind the iPhone, iPad, and Mac products since 1999 -- is leaving the company.

It’s a great loss for Apple and disheartening news for iPhone enthusiasts. Apple almost seems obsessed with the design language it introduced with the iPhone 11 series. And if recent leaks are any indication, we are going back to the iPhone X days with the non-Pro iPhone 16 models later this year.

Read more
A big iPhone update is right around the corner
An iPhone 15 Pro Max sitting upright, showing one of its home screens.

With announcements for 2024 models of the iPad Air and iPad Pro, today's been a busy day of Apple news. But the iPad isn't the only Apple product in the news today. Following the big announcements from its event earlier this morning, Apple also shared some important news regarding the next iPhone update.

As of Tuesday, May 7, Apple has begun rolling out RC builds for iOS 17.5. RC stands for "Release Candidate," and it's the last beta version of a software update that Apple releases before its final public rollout. In other news, the official iOS 17.5 update should be right around the corner.

Read more
I found an amazing new way to use my iPhone 15 Pro Max
The back of a Natural Titanium iPhone 15 Pro Max.

When Apple announced the iPhone 15 Pro series last September, there was one feature I was more excited about than anything else: the Action button. Gone was the useless ring/silent slider. In its place was a button we could customize to our exact liking.

I've been using the Action button on my iPhone 15 Pro Max ever since I got it, and for the last few months, it's been programmed to open the camera app. It's convenient, but it's also nothing particularly exciting. Recently, though, I found a new and unexpected way to use my iPhone's Action button — and it's kind of blowing my mind.
Supercharging the Action button

Read more