Watch a self-driving artificial intelligence try to drive around ‘GTA V’

By Brad Jones Updated May 19, 2017

Riding a bike in Grand Theft Auto V. — Rockstar Games

Grand Theft Auto V might be a fun anarchy simulator, but it’s proving to have some practical uses in the real world, too. Some AI developers are using it to prototype their self-driving car algorithms and now you can watch one of them learning as it goes, live on Twitch.

Last year, the Darmstadt University of Technology in Germany and Intel Labs collaborated on a method of pulling visual information from Grand Theft Auto V, according to a report from Bloomberg. The game has now been modified such that it can be used in research projects designed to perfect self-driving programs.

Recommended Videos

The AI currently trying its luck at driving around Los Santos is called Charles. It uses pixel-level-analysis of on-screen information to make decisions about how to drive around the fictional city. In essence, it uses the same visual data that a human driver would. For an idea of what Charles “sees,” the developer has put together a short image library to explain it.

Please enable Javascript to view this content

Crafted in Python — hence the Stream name, “Python Plays” — Charles currently doesn’t have any short-term memory, so doesn’t have much of an ability to learn. That’s why its driving is so poor right now and doesn’t seem to get much better no matter how long you view the stream. It does occasionally make it a few blocks without hitting anything and long-term viewers claim it is getting better, but it is far from being a safe or capable self-driving system.

Despite its obvious problems though, for a homebrew project by a single developer, the fact that it’s able to get around without any specialized information is reasonably impressive. You can imagine with time and further development, how an AI could become more proficient at driving by using a virtual toolkit like GTA V.

This kind of testing will hopefully help teach automated driving systems how to respond to unexpected obstacles with the same alertness and awareness as a skilled human driver. Anything can happen when you’re on the road, and it’s essential that an AI is able to respond appropriately, no matter what the eventuality.

At some point, self-driving technology will be advanced enough to stand up to trials on the same roads as every other human motorist. However, until we reach a certain level of sophistication, it will be the pedestrians roaming the streets in Grand Theft Auto V who bear the brunt of any unexpected occurrences.

Updated on 05-19-2017 by Jon Martindale: Added Twitch stream and information on it.

Topics

Former Digital Trends Contributor

Brad is an English-born writer currently splitting his time between Edinburgh and Pennsylvania. You can find him on Twitter…

Gaming

The best GTA 5 mods

Iron man flying in the sunset.

Since the release of Grand Theft Auto 5, players have been arguing over which version of the game is better. Regardless of which side of the debate you’re on, most people can agree that the PC version comes with a few advantages such as the various number of mods you can add to the game.

For those looking to upgrade their gameplay, we’ve created a list of the best GTA 5 mods you won’t want to play without.
Script Hook V and Native Trainer

Cars

Officers confused as they pull over an empty self-driving car

Cruise

In what appears to be the first incident of its kind, police officers recently pulled over a self-driving car with no one inside it.

The incident, which took place on a street in San Francisco earlier this month, was caught on video by a passing pedestrian. It shows several traffic cops pondering about how to handle the incident after stopping the vehicle for failing to have its front lights on while driving at night.

Gaming

Grand Theft Auto V upgrade brings three graphics modes

Michael from Grand Theft Auto V.

After months of speculation, we finally know exactly what improvements are coming to Grand Theft Auto V in its upcoming PlayStation 5 and Xbox Series X versions on March 15. The news comes via the official Rockstar blog, where the developer shares specifics regarding graphical updates, character migration, and more.

Most notable among the current-gen console enhancements is a series of new graphics modes aimed at letting players tailor the experience to their own preferences. Fidelity Mode provides 4K resolution at 30 frames per second (fps) with ray tracing, while Performance Mode offers an upscaled 4K resolution with a targeted 60 fps. Lastly is Performance RT Mode, which acts as a combination of the other two modes, with upscaled 4K resolution, ray tracing, and a targeted 60 fps.