Skip to main content

Google wants your smartphone to be able to save your eyes

Google wants smartphone cameras to help users with the detection of heart issues and diabetes-related complications that can lead to vision loss. Google says its Automated Retinal Disease Assessment (ARDA) tool has shown promising results at detecting a condition called diabetic retinopathy that can lead to blindness if not treated in time.

The company claims tests done in Thailand have proved ARDA’s accuracy and that it is safe to deploy, especially in areas where eye screenings are not easy due to lack of infrastructure or financial constraints. Google plans to conduct more in-depth tests to see if pictures of a person’s eyes clicked with a smartphone camera can be used to detect diabetes, as well as non-diabetes-related health conditions.

A phone’s eye to save your eyes

Google claims early tests have proved that its A.I. is already capable of flagging heart-related issues such as abnormal blood sugar and cholesterol levels by reading pictures of the exterior of a person’s eyes. In addition to deploying a phone’s camera, Google also wants to employ the onboard microphone for health benefits.

A diagram showing a person's eye outlines Google's plan to test using phone camera to detect health issues.
Image used with permission by copyright holder

Essentially, health experts at Google aim to use a phone’s microphone as a stethoscope to record heart sounds. The goal is to help detect issues such as aortic stenosis, a condition that blocks the flow of blood from the heart to the rest of the body. Instruments like a stethoscope or ultrasound machines are usually required to detect such conditions, but Google is testing whether a smartphone’s built-in mics can be used to do the same.

Some progress has already been made

Google has already baked in a feature in its Google Fit app that allows users to measure their respiratory rate, as well as heart rate, using a phone’s camera. To measure the respiratory rate, all that needs to be done is fpr a person to sit in front of the phone, fire up the selfie camera in the Google Fit app, and let A.I. do its magic by analyzing the movement of the torso as one breathes in and out. For checking the heart rate, just place a finger on the rear camera lens.

The company also has a dermatology tool in the pipeline that again banks on A.I. smarts to identify skin, hair, and nail conditions with just a few photos taken from a phone’s camera. Trained to recognize over 280 skin conditions, the A.I. then gives a list of possible ailments. However, it is not intended to self-diagnose problems, and users are still advised to consult with a certified health professional.

Editors' Recommendations

Nadeem Sarwar
Nadeem is a tech journalist who started reading about cool smartphone tech out of curiosity and soon started writing…
Google is bringing AI superpowers to your smartphone camera, and it looks ridiculous
Google Astra on a phone.

It seems AI assistants are antique, or that’s what Google wants you to believe, for we are in the era of AI agents -- and Google I/O 2024 has quickly proven that. Say hello to Project Astra, a generative AI agent with vision, text, and speech capabilities, with a sprinkling of memory and spatial awareness capabilities in tow.

Think of it as eyes for your phone that can make sense of the world around you. Point it at a mathematical equation, and it will solve it. Pointing the camera at a cat? Astra will suggest an apt name for the feline meow-ster. Ask it where you left your earbuds, and if the camera sensor has seen them, it will say something like, “You left them on the sofa.”

Read more
Google Photos is about to get a big AI upgrade
Google's Ask Photos debut.

At today's Google I/O 2024 keynote, the company announced that a new artificial intelligence (AI) feature is coming to Google Photos. "Ask Photos" is a new Google Gemini feature coming to the popular service, which now sees over 6 billion photos and videos uploaded to it daily.

With the new "Ask Photos" feature, you can soon search your photo library using a conversational approach rather than just keywords. For example, Google demonstrated that you can ask Google Photos for your license plate number or for photos of your child swimming over time by simply asking questions such as "What's my license plate again?" or "When did my daughter learn to swim?"

Read more
This is our best look yet at the Google Pixel 9 series
Pixel 9, Pixel 9 Pro and Pixel 9 XL leaks.

The Google Pixel 9 (from left), Pixel 9 Pro, and Pixel 9 XL Rozetked

When they finally launch, the Google Pixel 9, Pixel 9 Pro, and Pixel 9 Pro XL will not have many surprises — at least not when it comes to their design. Rozetked has revealed a series of new images showing the front, back, and sides of the Pixel 9 and Pixel 9 Pro XL, along with comparisons to previous Pixel models and the iPhone 15 Pro and Pro Max.

Read more