Skip to main content

Want to teach an AI to Zerg Rush? Blizzard and DeepMind have the tool for you

StarCraft II
Image used with permission by copyright holder
On Wednesday, DeepMind released a set of tools for researching and building artificial intelligence (AI) using StarCraft II as a learning environment. Blizzard first revealed DeepMind’s plans to use the popular sci-fi strategy game at the end of 2016, and said it was currently creating a rich application programming interface (API) just for training AI “agents” within the game.

The new StarCraft II-based toolset includes Blizzard’s Machine Learning API, a data set containing game replays performed by up to 500,000 anonymous users, and an open-source version of DeepMind’s PySC2 toolset. The kit also includes mini-games for developers to test their AI for specific tasks, and a joint paper listing baseline results along with an outline of the environment.

Recommended Videos

The lure of StarCraft II is that the game makes players really think. It’s all about strategy and defeating a single opponent by managing troops, resources, building equipment and bases, and conquering territories. It’s a war between two minds, starting from selecting a race to dominating the map and defeating the opponent.

AI “agents” (or bots) will approach StarCraft II just like any human. The Ai won’t have access to the back-end, it won’t be able to view the entire playing field from the start, and it won’t have any kind of software-based advantage that in the human world would be considered as cheating. AI agents will be required to make the same decisions in race selection, resource gathering, defense management, and in exploring unseen areas.

“The game also has other qualities that appeal to researchers, such as the large pool of avid players that compete online every day,” DeepMind said. “This ensures that there is a large quantity of replay data to learn from – as well as a large quantity of extremely talented opponents for AI agents.”

Another StarCraft II lure is the number of actions an AI agent can take. For instance, old Atari games only have around 10 different actions, such as up, down. left, right, and so on. In StarCraft II, the game provides more than 300 basic actions an AI agent can take. But according to DeepMind, there are around 100 million possible actions available on a screen measuring just 84 x 84.

As for the mini-games, these can be used by trained and untrained agents. They are essentially “assignments” inside StarCraft II used to see how an agent performs a specific task using a specific technique, such as selecting units, collecting minerals, and managing the camera.

Right now, there’s still progress to be made in terms of agents beating the game. DeepMind said that the strongest of baseline agents, A3C, can’t seem to beat the game’s built-in artificial opponent. According to DeepMind, in order for agents to be competitive, there needs to be a breakthrough in deep trial-and-error learning, and “other areas.”

“Our hope is that the release of these new tools will build on the work that the AI community has already done in StarCraft,” DeepMind said, “encouraging more DeepRL research and making it easier for researchers to focus on the frontiers of our field.”

Kevin Parrish
Former Digital Trends Contributor
Kevin started taking PCs apart in the 90s when Quake was on the way and his PC lacked the required components. Since then…
GeForce Now introduces a 100-hour monthly playtime cap
nvidia geforce now ultimate halfway across country 1

Nvidia’s GeForce Now is undergoing significant changes. Its Priority membership has been rebranded as the "Performance" tier, bringing an enhanced gaming experience at the same price. Performance members can now stream games at up to 1440p resolution and in ultrawide formats, with settings saved across sessions. This upgrade aligns the Performance tier closer to Ultimate, the highest tier, which supports 4K streaming and high refresh rates through GeForce RTX 4080-powered servers.

One of the most notable changes coming in 2025 is the introduction of a 100-hour monthly playtime cap for both Performance and Ultimate members, aimed at managing Nvidia’s cloud infrastructure. Nvidia also mentions in its blog post that this limit will affect only a small percentage of its player base, with over 94% of users typically playing well within this timeframe. To offer flexibility, Nvidia will allow up to 15 unused hours to roll over to the following month. Users who reach their limit can purchase extra playtime, with additional 15-hour blocks available at $2.99 for Performance members and $5.99 for Ultimate members.

Read more
These AI features might actually make me use Paint and Notepad again
Windows 11 logo on a laptop.

Your everyday Windows apps are going to get a whole lot smarter. As Microsoft mentions in its Windows Insiders Blog, using the Windows 11 Paint and Notepad app will improve thanks to new AI features that the tech giant is adding to make it more helpful for users. It's still in early testing, and there is no official information about when or if it'll roll out to all users.

For starters, the Notepad app for Windows 11, after getting an update that added autocorrect and spellcheck, is now getting a new Rewrite ability that helps you rewrite highlighted text following any instructions you add.

Read more
Best Samsung Galaxy deals: S24, Buds, Watches and more
The Galaxy Z Fold 4's Cover Screen.

Samsung’s Galaxy lineup is one of the more popular tech lineups on the market. Among it you’ll find some of the best headphone deals, best smartwatch deals, best tablet deals, and best phone deals available. Whatever piece of tech you may have your eye on Samsung likely has within the Galaxy lineup. These devices also see pretty significant discounts pretty regularly, so we thought we’d round up all of the best Samsung Galaxy deals to make finding the right Samsung Galaxy model for you more convenient. Read onward for all of the details on how to save, and if you’d like to shop more specifically within the Galaxy lineup you can start with Samsung Galaxy Z Flip 5 deals, Samsung Galaxy Z Fold 5 deals, Samsung Galaxy Buds deals, or Samsung tablet deals.
Samsung Galaxy Buds Pro 2 — $107 $199 46% off

The Galaxy Buds 2 Pro are the high-end model of Samsung’s Galaxy Buds earbuds. They make great competition for the best wireless earbuds even if they don’t make everyone’s list, and with their Intelligent Active Noise-Cancelation technology they compare well with the best noise-canceling headphones. The Galaxy Buds 2 Pro produce high quality audio whether you’re listening to music, watching movies, or talking on the phone, and they pair easily with any Bluetooth device.

Read more