Skip to main content

Disney’s Magic Bench brings animated characters to life, no AR goggles needed

Magic Bench
Disney has begun showcasing one potential application for augmented reality: third-person interactions with digital characters. Using an RGB camera and depth sensor, Disney Research was able to create an experience where a user who sits on the bench can see themselves sitting next to a fully animated and interactive character. With haptic actuators fitted to the bench as well, there’s even the ability to ‘feel’ those digital characters’ actions in the real world.
Recommended Videos

Augmented reality headsets like Microsoft’s Hololens show an exciting potential future for the technology, and Disney’s Magic Bench shows how this tech can be leveraged now to create unique experiences. Magic Bench offers an insight into how some relatively simple hardware and software can be used to build memorable interactions with animals, useful weather features, and a changing environment.

As well as being quite hardware light, these experiences can also be enjoyed by groups, with a number of people in each scene able to interact with the characters, what’s going on around them and most importantly see it all happening on the screen in front of them.

Set to be shown off to the public for the first time at the upcoming SIGGRAPH 2017 event on July 30 in Los Angeles, the Magic Bench uses a clever combination of its limited hardware components to construct the digital scene. The RGB camera creates a 2D rendition of the scene, which is combined with 3D information from the depth sensor. Although their perspectives are subtly different, creating what Disney calls “depth shadows,” a recreated 2D backdrop can be algorithmically lined up to create the final, complete digital scene.

The standard wooden bench is an important part of the hardware involved, too. It acts as a stage and a middle-ground between foreground and background. That way, Disney knows that a digital character passing behind the bench should pass behind the viewers and if moving in front, it should appear in front of the viewers.

As Phys highlights, it even acts as a controller, automatically activating the experience when someone sits down upon it, potentially creating a joyful surprise for anyone not expecting to see themselves interacting with digital characters on the screen in front of them.

Augmented Reality at Disney Research

Disney seems particularly excited by the potential of augmented reality to bring physical-world features into the digital, some of which were shown off in another video by the research division. From children’s drawings impacting digital models, to augmented reality museums, it seems safe to say that Disney is investing heavily in augmented and mixed reality research and its developments will be worth keeping an eye on in the years to come.

Jon Martindale
Jon Martindale is a freelance evergreen writer and occasional section coordinator, covering how to guides, best-of lists, and…
I have a theory on how the PS5 Pro could actually outclass PCs
The PS5 Pro suspended in air.

Without a doubt, the PlayStation 5 Pro is the most powerful game console we've ever seen. It's set to launch next week, promising "45% faster rendering" on the back of a beefier graphics card and faster memory. It won't be enough to outclass a proper gaming desktop packing one of the best graphics cards -- not even close. But the PS5 Pro could have an edge over PCs in one area.

I say "could" because we really don't know. AMD pointed me to Sony, and Sony hasn't returned my request for comment about the specifics under the hood of the PS5 Pro. I have some hints, however, and if you'll indulge a little speculation, I have some interesting theories about how the PS5 Pro might have an edge over even powerful gaming PCs.
The PS5 Pro's secret weapon

Read more
Intel Battlemage GPU: everything we know so far
Intel Arc A770 GPU installed in a test bench.

Despite a rocky start, Intel's Arc GPUs are now among the best graphics cards you can buy. Targeting budget PC gamers, Intel has established itself as a major player in gaming graphics cards, and all eyes are on Team Blue with its next generation of GPUs, codenamed Battlemage.

We know Battlemage GPUs are coming, and Intel has slowly been dropping hints about the graphics cards over the past year. Although we're still waiting on an official release date, specs, and pricing details for Battlemage GPUs, there's a lot we can piece together already.
Intel Battlemage: specs

Read more
Spotify vs. Pandora: which streaming service should you choose?
spotify vs pandora on iphone

Let's settle a musical debate: which music streaming platform should you use: Spotify or Pandora?

Both services have their unique strengths and weaknesses. Spotify boasts a more extensive music catalog, robust social features for sharing and discovering music with friends, and a more polished user experience across devices.

Read more