Skip to main content

Nvidia shows off virtual reality-taught robots at SIGGRAPH 2017

nvidia isaac vr training dominoes siggraph isaac01
Nvidia
Nvidia has been teaching robots how to play games and perform more practical tasks using virtual reality and it is showing off what they can do at this year’s Special Interest Group on Computer Graphics and Interactive Techniques (SIGGRAPH) show. If you attend, you can play a game of dominoes against Isaac, or delve into his namesake platform to discover just how Nvidia uses VR to train robotics of the future.

Training robots is far from easy. Programming every one of their tasks for every eventual outcome is a time consuming and relatively fruitless task for programmers, so more recently artificial intelligences (AI) and their real-world physical robotics, have been taught through machine learning.

Recommended Videos

The Isaac Lab Robot Simulator is the core technology that Nvidia is demoing at SIGGRAPH 2017 and it is using a little, humanoid robot named after the program to do it. He features treaded tracks for locomotion, twin-grip hands for manipulation, and a pair of camera-equipped eyes for tracking the real world. He even has a mouth and pseudo nose, which adds just enough humanity to steer clear of the uncanny valley.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!

Like other game-playing AI, Isaac is an expert at them and visitors to this year’s SIGGRAPH show can test his skills in a game of dominoes. But that is only one plane of existent that you can interact with Isaac in. Putting on a virtual reality headset, you will be able to step into the world as Isaac sees it and interact with a digital version of him in VR.

That virtual realm is Nvidia’s Holodeck technology — a collaborative, virtual workspace that allows designers and developers to work together to create something in a virtual environment. It supports photorealistic models too, so all participants can have a view of a product or object as it would be in the real world, without it ever existing there.

Isaac exists in both, though, and that is what Nvidia wants to promote at SIGGRAPH 2017 — its VR robot training system. It is designed to take the cost and risk out of training a robot using machine learning. Instead of making mistakes and potentially damaging the robotics or their environment, AI can explore and learn through trial and error in a virtual space that offers the same parameters as the real world.

That lack of risk is important for human interaction and makes it possible for AI to have near-infinite interactions with humans without the potential problems that could arise through those same interactions in the real world. Nvidia Isaac offers real-time rendering and developmental tools to aid creation in VR environments to train AI.

Nvidia is not the only one showing a blending of realities with digital entities at SIGGRAPH 2017 though. Disney introduced a “Magic Bench” which lets sitters interact with all sorts of animated characters.

Jon Martindale
Jon Martindale is a freelance evergreen writer and occasional section coordinator, covering how to guides, best-of lists, and…
Hurry! The M4 MacBook Pro just got an unheard of discount
Someone using a MacBook Pro at a desk.

The 2024 MacBook Pro with M4 chip hasn't even been out for a month, but it already has its first major discount. Amazon just knocked $200 off the 14-inch configuration, dropping the price to $1,399 from $1,599. While a $200 discount on a MacBook isn't world-shattering, the fact that this laptop is so new makes this an unheard of deal. Let's dive into some other noteworthy aspects of this sale.

Why you should buy the MacBook Pro M4
This specific configuration of the M4 Pro has a 10-core CPU, 10-core GPU, 16GB of RAM and 512GB of SSD storage. The 16GB of RAM is particularly noteworthy, as it's the new standard for Apple. That makes this a better deal than some of the M3 models with 8GB of RAM. This model of course comes with Apple's signature Liquid Retina XDR display on its 14.2-inch screen, and it's ready for Apple Intelligence.

Read more
Google may finally bring back the Pixelbook, but not how you think
google pixelbook i7 price cut amazon

One of Google’s upcoming big projects could be a high-end laptop slated to be the next rival of the MacBook Pro.

An internal email obtained by Android Headlines detailed that Google has greenlit a project for a device codenamed “Snowy.” The email suggests the device is a laptop with premium specifications similar to the Dell XPS, Microsoft Surface Laptop, the Samsung Galaxy Chromebook, and the brand’s largest competitor, Apple’s MacBook Pro. With the project past the concept phase, it would likely be quickly expanded into a viable product under the Pixel line.

Read more
Best early Black Friday deals under $100: Amazon Echo, TVs, headphones and more
The Amazon Echo Pop on a desk.

Update 11/19/24: Black Friday is still over a week away, but you can already start your shopping with the Black Friday deals under $100 that we've gathered here. There's a possibility that these affordable items get even bigger discounts when the sale officially launches, but we won't blame you if you're already tempted by today's prices.

Black Friday will start on November 29, but if you've already got the itch to shop, check out the early Black Friday deals under $100 that we've gathered here. The offers cover smart home devices, laptops, TVs, kitchen gadgets, and so much more, so if you want to start enjoying discounts without blowing your entire budget for the shopping event, take a look at our favorite bargains below.

Read more