Skip to main content

Google’s ARCore platform can now track faces, boasts improved memory

Google is continuing to improve its augmented reality platform, ARCore, and has released an update for Android and iOS that adds facial augmentation and improves the existing Cloud Anchors that allowed for AR object permanence.

That sounds complicated, but it’s less complex than it initially seems. The new addition, Augmented Faces, allows users to attach fun effects to their faces that follow their movements and react to their expressions in real time. The technology is similar to iOS’s Animojis and Memojis — except with a key difference. While iOS’s in-built AR effects require a depth-sensing camera (the TrueDepth selfie lens on the latest iPhones), ARCore’s new feature is able to recreate this effect without the need for advanced hardware. To achieve this, Augmented Faces lays a 3D mesh over your face with 468 individually tracked points — with each point corresponding to a specific point on the AR effect. Basically, think of Snapchat’s filters, but better.

The second major part of this update consists of improvements to ARCore’s Cloud Anchors. Introduced in May 2018, Cloud Anchors allow for a certain amount object permanence between devices. Essentially, draw an arrow on a wall with an Android device, and a friend on an iPhone will be able to see it. That may seem minor, but imagine being able to leave a breadcrumb trail of AR directions for a friend while you’re out, or view AR models of spacecrafts together.

Recommended Videos

This sort of social AR experience is something Google is eager to explore, and this update makes the existing cloud anchors more robust and efficient. More angles are processed when the anchor is created, making steadier and more realistic — so elements are less likely to come loose from their anchor and drift across your screen.

Outside of exceptions like Pokémon Go or Harry Potter: Wizards Unite, it’s probably fair to say augmented reality plays little role in most people’s lives. Part of the reason for that is, well, it doesn’t really have much use yet. However, Google’s recent addition of AR directions to Google Maps — which uses your phone’s camera and screen to overlay directions on the real world — shows what’s possible with augmented reality. This update for ARCore may not be the most exciting update so far — but it’s a big step along the road to AR becoming from commonplace in our lives. If you’re eager to check out what’s currently possible in AR, check out our list of the best AR apps for Android and iOS.

Mark Jansen
Mobile Evergreen Editor
Mark Jansen is an avid follower of everything that beeps, bloops, or makes pretty lights. He has a degree in Ancient &…
This strange iOS bug can crash your iPhone in seconds
The App Library on the iPhone 14 Plus

Bored? Swipe all the way over to the App Library on your iPhone and type "":: in the search bar. Congratulations! You've just crashed your iPhone. But don't worry — it's not permanent or serious, according to security researchers.

Mastodon user Konstantin found that typing those four characters into the search bar will crash SpringBoard, the app responsible for the iPhone home screen. All it does is throw the phone into a loop for a moment before returning you to your lock screen. It doesn't close any apps or cause any other issues; if anything, it's just a reset. I tested it on my device and found nothing out of the ordinary.

Read more
You can finally try AI features on your iPhone with the iOS 18.1 beta
Apple Intelligence on iPhone pulling data from across apps.

If you’re part of the Apple Developer program and have been trying out the iOS 18 beta on your iPhone, then go grab the latest iOS 18.1 developer beta. This is a significant update, as it finally brings Apple Intelligence features to your iPhone 15 Pro or iPhone 15 Pro Max.

As of right now, Apple has only released the iOS 18.1 beta for developers. There is no public beta for iOS 18.1 yet, but it may be coming soon. You’ll also need the iOS 18.1 beta on an iPhone 15 Pro or iPhone 15 Pro Max, as those are the only two iPhone models that are capable of running Apple Intelligence features, though iOS 18 can go on devices as far back as the iPhone XS.

Read more
The iOS 18 public beta should be released any day now
The iOS 18 logo against a blue and pink background.

Apple just released an updated build for its third iOS 18 beta to developers. This comes on the heels of widespread anticipation for the first public beta, which did not come to fruition today. But if this is any indication, we are getting very close to the public beta in the coming days.

Apple released the first developer build of iOS 18 right after its WWDC 2024 keynote on June 10, 2024. A week ago, Apple dropped the third developer beta for iOS 18, which had build number 22A5307f. Typically, Apple releases the public betas a week after the third beta, at least according to the previous year’s records.

Read more