Skip to main content

Project Tango can remember where it's been, making AR work even when your device is distracted

Sundar Pichai stands in front of a Google logo at Google I/O 2021.
This story is part of our complete Google I/O coverage

Project Tango
Image used with permission by copyright holder
If you’re not familiar with Google’s Project Tango, it’s an image recognition platform, to put it simply. Using a special 3D camera, a Tango equipped device “looks” at the world around it, and uses that information to map a space, add in augmented reality objects, or simply track the location of a mobile device.

It has a wide variety of uses, even in its developer-oriented form, but there are some issues. For one, even the precision accelerometers and gyroscopes in mobile phones tend to have a margin of error, especially with vigorous movement. Add to that the way lighting changes, and user movement, and you might notice some drift or enlarging of objects that are supposed to stay still. Which brings us to the topic of today’s Google I/O talk by Tango team leader Wim Meeussen.

Recommended Videos

Learning its way around

The solution to object drift is area learning. Instead of constantly looking at its surroundings and calculating a new position, area learning allows a Tango device to recognize its surroundings. By building a memory of the world around it, the Tango device can recognize those spaces, and properly fit objects back into them.

Please enable Javascript to view this content

Several demos served to illustrate how well this worked. A simple app, lacking area learning, placed a virtual box on a flat surface. After turning away from the podium and shaking the Tango powered device, the box began to slide around. Eventually, it disappeared, as the device entirely lost track of where the box should be.

Turning on area learning produced entirely different results. Not only did the box stay as the device shook and looked away, but even covering the camera for several seconds didn’t affect its positioning. Granted, it sometimes took a few seconds to re-identify the space around it, but once it did, the box popped right back up.

Memory makes for better multiplayer

Area learning really opens up the possibilities of VR and AR gaming with multiple users. Google says the Tango area learning code is easy to implement (capturing a location memory takes one line of code), and sharing it with other devices even easier (also just one line of code.)

For a multiplayer game, one device can capture a location memory of the space, and then export that location memory to other devices in the area. Working from the same model of the room, the devices are able to keep even better track of each other and their surroundings.

The results speak for themselves. In a video demo two users handed back and forth a Tango enabled tablet, with their heads and the device mirrored perfectly in a virtual rendering of the space. All of this takes place without establishing any infrastructure in the area, and with minimal code alterations.

What’s next?

If the results of area learning are any indication, Tango is coming along quite nicely. Object permanence, navigation, and multiplayer components are all a big part of the equation, and they must not be far from production. In fact, Meeussen made sure to remind everyone that Lenovo would be releasing a Tango-equipped device targeted at consumers later this year.

For now, eager AR users will either need to learn to develop, or wait patiently for the first device with Google’s powerful new technology.

Brad Bourque
Former Digital Trends Contributor
Brad Bourque is a native Portlander, devout nerd, and craft beer enthusiast. He studied creative writing at Willamette…
Intel’s promised Arrow Lake autopsy details up to 30% loss in performance
The Core Ultra 9 285K socketed into a motherboard.

Intel's Arrow Lake CPUs didn't make it on our list of the best processors when they released earlier this year. As you can read in our Core Ultra 9 285K review, Intel's latest desktop offering struggled to keep pace with last-gen options, particularly in games, and showed strange behavior in apps like Premiere Pro. Now, Intel says it has fixed the issues with its Arrow Lake range, which accounted for up to a 30% loss in real-world performance compared to Intel's in-house testing.

The company identified five issues with the performance of Arrow Lake, four of which are resolved now. The latest BIOS and Windows Updates (more details on those later in this story) will restore Arrow Lake processors to their expected level of performance, according to Intel, while a new firmware will offer additional performance improvements. That firmware is expected to release in January, pushing beyond the baseline level of performance Intel expected out of Arrow Lake.

Read more
You can get this 40-inch LG UltraWide 5K monitor at $560 off if you hurry
A woman using the LG UltraWide 40WP95C-W 5K monitor.

If you need a screen to go with the upgrade that you made with desktop computer deals, and you're willing to spend for a top-of-the-line display, then you may want to set your sights on the LG 40WP95C-W UltraWide curved 5K monitor. From its original price of $1,800, you can get it for $1,240 from Walmart for huge savings of $560, or for $1,275 from Amazon for a $525 discount. You should complete your purchase quickly if you're interested though, as there's no telling when the offers for this monitor will expire.

Why you should buy the LG 40WP95C-W UltraWide curved 5K monitor
5K monitors are highly recommended for serious creative professionals, such as graphic designers and filmmakers, for their extremely sharp details and precise colors, and the LG 40WP95C-W UltraWide curved 5K monitor is an excellent choice. We've tagged it as the best ultrawide 5K monitor in our roundup of the best 5K monitors, with its huge 40-inch curved screen featuring 5120 x 2160 resolution, 98% coverage of the DCI-P3 spectrum, and support for HDR10 providing striking visuals that you won't enjoy from most of the other options in the market.

Read more
Generative-AI-powered video editing is coming to Instagram
Instagram on iPhone against a colorful background.

Editing your Instagram videos will soon be as simple as typing out a text prompt, thanks to a new generative AI tool the company hopes to release in 2025, CEO Adam Mosseri announced Thursday.

The upcoming tool, which leverages Meta's Movie Gen model, will enable users to "change nearly any aspect of your videos," Mosseri said during his preview demonstration. Those changes range from subtle modifications, like adding a gold chain to his existing outfit or a hippo in the background, to wholesale alterations including swapping his wardrobe or giving himself a felt, Muppet-like appearance.

Read more