Skip to main content

Apple is bringing keyboard and mouse gaming to the iPad

Apple is adding pointer capture to iPad gaming, which means that users will be able to play complex video games on the device for the first time.

“Level up your iPad games and add in keyboard, mouse, and trackpad controls,” the company told developers when describing a WWDC 2020 session about the new controller scheme. “Discover how to use the Game Controller framework to augment your existing titles, bring over games from other platforms, or dream up entirely new interaction experiences.”

iPads have allowed pairing with Xbox and PlayStation controllers for a while now, but this would be the first time developers will be able to make use of pointer capture with mouse and keyboard controls, widely considered the bench standard for PC gaming.

“Learn how to integrate keyboard and ‘delta’ mouse coordinate events for player motion, and disable system gestures like the Dock or Control Center to take full advantage of full-screen gameplay,” Apple said.

The news is being lauded by developers mainly because Apple and its products have been slow to delve into the world of video games.

The Apple app store is packed with games, but none of them have the cachet of a traditional big release on something like a PlayStation 4 or PC. However, Apple has been making moves to change this, and the past year has seen serious inroads into the more mainstream video game ecosphere.

In September of last year, Apple launched Apple Arcade, a $5 monthly subscription service touting more than 100 ad-free games, and users can play games with a DualShock 4 or Xbox One controller. Apple does not yet have its own controller.

Playing games on an iPad or iPhone is fairly simple with a game that requires simple touch controls but becomes complicated when trying to play games with more complicated control schemes, like Grand Theft Auto III. While adding controller support helped, games like Fortnite on PC have ravenous followings and are played with a mouse and keyboard. Adding support for pointer capture means that Apple could potentially offer players the same experience on the iPad that they’re getting from a full PC or laptop rig.

Steve Troughton-Smith, a developer that builds apps and games, tweeted that the move was a “huge deal for gaming on iPad.”

Editors' Recommendations

Nvidia is bringing ChatGPT-style AI to video games, and I’m already worried
Nvidia CEO delivering a keynote at Computex.

Nvidia is bringing generative AI to video games. Announced during its Computex 2023 keynote, Nvidia ACE is a new platform that allows developers to use generative AI to power conversations with characters in games.

Think ChatGPT, but instead of a general-purpose chatbot, you get a chatbot with a specific backstory and lore. Nvidia is stressing that flexibility is one of the most important aspects of ACE, as it will allow characters to have a fleshed-out backstory that informs their responses and keeps them from getting too off-topic. The company's recently announced NeMo Guardrails play a role in this, directing the conversation away from topics the developer doesn't intend.

Read more
All Xbox One games with mouse and keyboard support
The protagonist of Assassin's Creed: Valhalla shouting in battle and wielding two axes.

While the last-gen Xbox One isn't as powerful as the Xbox Series X, it's still a worthwhile console and has a huge library of great games.

If you're looking to stay competitive while playing online multiplayer games versus next-gen console and PC players or are just looking to avoid some wonky console interface that's difficult to navigate, you may want to try using a keyboard and mouse with your Xbox One. A keyboard and mouse will give you better precision than your standard Xbox One controller so you can keep up in cross-platform games without shelling out money for a top gaming PC.

Read more
Netflix may bring its gaming service to TVs, with iPhones serving as controllers
The Netflix Games section.

Netflix is working on a feature that will bring its games to smart TVs and allow players to use their iPhone as a controller, reports from Bloomberg and MacRumors' Steve Moser said on Wednesday.

The move would take Netflix’s gaming service beyond only smartphones and tablets, giving subscribers more ways to play. And for iPhone owners, it also eliminates the need to buy a dedicated controller, making it more likely that people would give its games a go.

Read more