Skip to main content

What is augmented reality?

Augmented reality brings VR to the real world in all sorts of exciting ways

As digital technology becomes more integrated with our everyday lives, the search is on to find more intuitive ways to interact with it. Augmented reality is a very real attempt to achieve such a system, bringing interactive video, social networking, education, training, and gaming into the real world in ways that were purely the realm of science fiction in decades past.

What is augmented reality? It’s a blending of the real and virtual worlds and could one day become the default way that we interact with a variety of digital services.

Recommended Videos

Further reading

More than just a HUD

As with many advanced technologies, augmented reality was first developed for military use. It debuted in the early 1990s with the U.S. Air Force’s virtual fixtures, although head-up displays (HUD) and headset designs had been conceived and developed for almost a century beforehand. These sorts of HUDs that provide information to the headset wearer in the form of digital readouts or gauges have long been a staple of science fiction movies and games, but that was only a hint of what augmented reality could offer a far broader audience.

In much the same manner as virtual reality, early implementations of augmented reality suffered from a lack of raw computing power to render the visuals required for realistic digital graphics, as well as the small-screen technology needed to display it comfortably. The fast-paced development of smartphones since the turn of the century and the continual shrinking and performance enhancements of graphics technology mean that the past decade has seen incredible advancements in augmented reality technology too.

From QR Codes to Pokémon Go

best augmented-reality apps
Image used with permission by copyright holder

One of the first ways that many people interacted with augmented reality was by pointing their smartphone at a QR code on a table. Augmented reality applications can translate that particular coded image into a virtual item on the screen. Some camera apps even include the option to add virtual elements to a photo, along with some measure of 3D sensing that allows them to move around the picture as if they were part of the scene.

Augmented reality truly hit the mainstream in 2016, however, with the launch of Pokémon Go. The clever combination of a nostalgic franchise with real-world location tracking and the ability to “see” those pocket monsters jumping around on a real street or park bench made for an intoxicating and popular gaming fad that still continues — albeit with far fewer players — to this day.

Augmented reality toy lines like Mekamon and Anki Overdrive combine elements of physical robotics and traditional toys with digital interactions via a smartphone to enhance gameplay in new and exciting ways. Educational applications like BBC Civilisations and Mondly help you learn about the world or a new language with interactive augmented reality elements, all displayed through your smartphone screen.

But smartphone AR is just the tip of the augmented reality iceberg. Full head-mounted displays hint at a future where games, training simulations, YouTube videos, conference calls, and more can all be virtually displayed right in front of our eyes, without losing sight of the real world, making AR both immersive and intuitive at once.

Learning, playing, and living in headsets

Microsoft

Google Glass was arguably the first augmented reality headset to capture the public’s imagination, but it didn’t necessarily do so in a positive light. The technology was ultimately a little underpowered and under-featured, and raised a number of concerns about privacy and distracted driving. It only took a couple of years before Google stopped selling it in favor of focusing on Android Wear devices instead. But in its absence, the AR headset scene has grown considerably, with new and exciting products and services launching all the time.

Microsoft’s first-, and now second-, generation Hololens headsets showcase much more exciting applications of augmented reality than just checking social media feeds. Architects and 3D designers can wear them when creating new buildings or products, giving them the option to “build” in augmented reality, then move from a god-like view of their creation to a scale model that they can walk around. This can all be done while retaining the ability to access real-world tools in their periphery, or by switching away from their digital creations for a second.

Unlike virtual reality, augmented reality lets you maintain a much firmer grasp on the world around you. That makes it easier to stay grounded with your digital experience, but also blend the two worlds together. You could place digital items you’re working with on your actual, physical desk. When constructing a building, developers could use augmented reality to overlay where pipes and electrics are or need to be installed.

Hololens Plant Maintenance

At a recent demo of Hololens 2 at Microsoft’s Build 2019, the company showed how a wearer could use a collaborative meeting tool to interact with other AR headset wearers in a virtual meeting room. Avatars of other participants can be present in the 3D space to collaborate on shared media, and even non-headset wearers could participate through floating 2D screens that are visible within the mixed reality space.

Training and education are an exciting potential growth area for augmented reality too. Imagine doing home plumbing where not only can you see a floating video screen giving you instructions on how to proceed, but also contextual arrows or highlights that point you to the piece of pipe or fitting you need to adjust — all completely hands-free. Surgeons and doctors can use it for learning about certain procedures, or overlay existing data like MRI scans or X-rays over patients on an operating table.

Magic Leap One Creator Edition | Encounter New Worlds

Magic Leap’s googly-eyed goggles showcase another side of augmented reality in the home. It makes it possible to customize the size of a virtual TV in your living room, play a digital board game on a tabletop, snuggle with a virtual pet on your sofa, or pull up a calendar and organize your day within your very real home office.

What’s next?

The technologies underlying augmented reality headsets and software are advancing all the time. They’re getting smaller, lighter, more detailed, and more credible by the day. Augmented reality looks set to revolutionize on-the-job training, and enhance the abilities of designers, artists, retailers, game developers, and office workers. It may even one day become the way we interact with the internet as a whole — if they can figure out a good way to display web pages in it.

But it’s not quite there yet. These technologies can still be prohibitively expensive. A Hololens 2 headset that holds all sort of exciting potential is still $3,500. That keeps it in the realm of businesses and wealthy early adopters. But as we’ve seen with smartphone technology over the past decade and virtual reality in the past half of it, the prices eventually come down and the technology only becomes more accessible.

In the decade to come, augmented reality is likely to change the way we interact with the digital world forever.

Jon Martindale
Jon Martindale is a freelance evergreen writer and occasional section coordinator, covering how to guides, best-of lists, and…
This is what Apple’s in-store Vision Pro demo will likely be like
A person wears an Apple Vision Pro headset. Their eyes are visible through the front of the device.

Anyone interested in buying Apple’s Vision Pro mixed-reality headset will be encouraged to sign up for an in-store demonstration of the device so that Apple can ensure they have the best possible experience with it from the very beginning.

The tech giant is about to launch its most important product since the Apple Watch in 2015, and with many people never having gone near such a device, Apple wants to ensure that the initial experience with the Vision Pro is as good as it can be.

Read more
Google Glass is back? In spirit, yes
RayNeo X2 Lite AR glasses are slim and lightweight.

RayNeo X2 Lite AR glasses are slim and lightweight. RayNeo

It's been a long time since Google Glass fell on its face, but at CES 2024, some advanced AR companies are attempting a revival of sorts.

Read more
Xreal brings spatial computing to a pair of AR glasses
Xreal Air 2 Ultra AR glasses feature depth sensors.

Xreal just announced its latest pair of AR glasses ahead of CES 2024. The Xreal Air 2 Ultra are a pair of AR glasses that have spatial computing capabilities that allow you to control interfaces with hand gestures.

Based on the Xreal Air 2 smart glasses, this new product adds tracking and 3D sensing technology without the bulk and weight of earlier solutions.

Read more