Skip to main content

Leap Motion is pioneering how users interface with menus in mixed reality

Image used with permission by copyright holder

Along with advancing the idea of augmented reality “goggles” that have their own AR headset, Leap Motion may also pioneer a new way to interface with menus in its mixed reality environments. In a new demonstration of a prototype in the works, Leap showed off how its translucent user interface can be moved around, minimized, tapped, touched, and dragged wherever the user wants.

There are a number of aspects of augmented reality that still need a lot of work and experimentation. Although some standards of quality and interaction are coming together, menus are one item that nobody has quite figured out how to do just right yet. Leap Motion, best known for its VR hand trackers, is taking steps to figure this out though and its newest demo could point to a future where the headset wearer controls the interface just as much as the interface controls the augmented environment.

Recommended Videos

Another day at the augmented office. Our latest foray into #AR design with #ProjectNorthStar makes your entire world interactive. pic.twitter.com/SB8SNidbCG

— Ultraleap Developers (@ultraleap_devs) April 24, 2018

The system shown off in the tweet leverages Leap Motion’s prototype “Project Northstar” headset to enable virtual menus that float around the user in augmented space. We’re shown how they are translucent, to allow for a better view of the world around the user while still enjoying the information and digital functionality they provide. They won’t necessarily be in the user’s face all of the time though, as we’re shown how they can be moved to where is most appropriate in the 3D space, as well as minimized entirely in easy-to-grab locations such as on the edge of a desk.

Certain interactions with the menus were also showcased, including menus that react to motion that occurs near them, and buttons and sliders that are easily manipulated. As RoadToVR highlights, too, the fact that each menu appears to have some sort of visual weight to it should engender a more natural feel to the system in an augmented space.

Unlike some demos of augmented reality that we’ve seen in the past, Leap Motion makes it clear that there is “zero trickery” going on in this short video; everything is shot through the headset, giving us the best look we can get of what Leap Motion’s AR UI might look like in the future.

It’s all still very early stages though. Project North Star was only announced earlier this month, though it does offer an impressive feature set of low-latency, high-resolution displays and a 100-degree field of view. Leap Motion suggested production costs could be under $100 per headset when produced in high volumes.

Jon Martindale
Jon Martindale is a freelance evergreen writer and occasional section coordinator, covering how to guides, best-of lists, and…
Apple’s VR headset has no killer app, prominent leaker warns
A woman using a VR headset at a desk with an Apple MacBook,

Apple’s Reality Pro headset lacks a clear focus and has no killer app that will make it a must-have item. That’s the warning from Bloomberg journalist Mark Gurman based on information from his industry sources, and it comes just a few weeks before Apple’s much-fêted device gets released to the public.

Yet it’s not all bad news, and Apple has been here before with other products that have eventually come good. The question is whether the Cupertino giant can make its mixed-reality headset a success before the public loses interest.

Read more
New leak reveals exactly how Apple’s VR headset will work
A man using a virtual reality headset with controllers.

Apple’s forthcoming Reality Pro headset hasn’t even launched, yet it’s already been plagued by negative stories and general skepticism about its prospects. Yet a new report claims Apple is going to come out swinging with a full gamut of blockbuster apps and games for its high-end device, all in an attempt to win over wary customers.

First reported by Bloomberg journalist Mark Gurman, Apple is apparently building a host of apps and experiences that will entice people to shell out around $3,000 for the mixed-reality headset. These will include games, workouts, collaboration tools, and much more, with a mixture of virtual reality (VR) and augmented reality (AR) options.

Read more
Leak reveals how Apple VR headset’s hand tracking may work
A rendering of an Apple mixed-reality headset (Reality Pro) in a gold color seen from the front.

Apple’s secret mixed-reality headset -- dubbed Reality Pro -- is due to launch imminently, but the way you’ll use the device is something of a mystery. Sure, rumors have pointed to some form of gesture control, but that’s a pretty vague description. Fortunately, we might now have a better idea of how it will work.

That’s because Apple has just been granted a patent outlining how you might be able to use a special ring to control objects while using the Reality Pro headset. The idea is that, with this ring on your finger, you’ll be able to perform various gestures that will let you open apps, scroll webpages, and more.

Read more