Skip to main content

AI just came to VR in a big way

Alan Truly wears a Meta Quest 3 while laying down with a Meta AI prompt overlaid.
Alan Truly wears a Meta Quest 3 while laying down with a Meta AI prompt overlaid. Photo by Tracey Truly / Digital Trends

Meta just announced a huge update to its AI and it’s coming soon to the Meta Quest platform, home to some of the best VR headsets you can buy. In the next few weeks, you’ll soon have access to a smart voice assistant anytime you wear your Quest 3, Quest Pro, or Quest 2.

You can see some examples of how Meta AI works on the Quest 3 in the video below. Note that Meta AI can use the Quest 3’s and Quest Pro’s mixed reality mode to see real-world objects and answer your questions. The Quest 2’s black-and-white passthrough camera isn’t supported for visual input.

Introducing Meta AI on Meta Quest ✨ Rolling out this August in experimental mode.

Meta Quest VR headsets in the U.S. and Canada will start getting these new multimodal AI capabilities as early as August. It will be a gradual rollout, so you might not see the update until September.

Recommended Videos

I asked Meta about generating AI images in Quest headsets and whether the AI would be able to see my Meta avatar and virtual environment. Those features might come at a later date, but won’t arrive in the next update.

Meta AI has been in Facebook, Messenger, and WhatsApp since September 2023, helping you with customized AIs for cooking, jokes, and games. It can even generate images when you use the @MetaAI /imagine command while chatting with a friend.

Meta AI also supercharges Ray-Ban Meta Smart Glasses, giving you cutting-edge AI assistance wherever you go. The upcoming Meta Quest update will bring a version of AI that’s similar to what’s available in Meta smart glasses. You can ask general questions like what to wear in the typically hot weather of Palm Springs and even hold up a pair of shorts and ask Meta’s AI to suggest a matching top.

This announcement came at the same time Meta announced its 405B parameter Llama 3.1, the largest AI ever released as open source. Meta also posted AI benchmarks that indicate Llama 3.1 is competitive with the latest OpenAI and Anthropic models.

You can try Meta AI 3.1 right now at meta.ai and on WhatsApp in the U.S. Keep your Meta Quest VR headset plugged in and in sleep mode to get the update as soon as its available in your area.

Alan Truly
Alan Truly is a Writer at Digital Trends, covering computers, laptops, hardware, software, and accessories that stand out as…
Google’s new Gemini 2.0 AI model is about to be everywhere
Gemini 2.0 logo

Less than a year after debuting Gemini 1.5, Google's DeepMind division was back Wednesday to reveal the AI's next-generation model, Gemini 2.0. The new model offers native image and audio output, and "will enable us to build new AI agents that bring us closer to our vision of a universal assistant," the company wrote in its announcement blog post.

As of Wednesday, Gemini 2.0 is available at all subscription tiers, including free. As Google's new flagship AI model, you can expect to see it begin powering AI features across the company's ecosystem in the coming months. As with OpenAI's o1 model, the initial release of Gemini 2.0 is not the company's full-fledged version, but rather a smaller, less capable "experimental preview" iteration that will be upgraded in Google Gemini in the coming months.

Read more
MSI’s Claw 8 AI+ is more than just a refresh
The MSI Claw 8 AI+ gaming handheld.

MSI has just unveiled two next-gen gaming handhelds, the MSI Claw 8 AI+ and the Claw 7 AI+. A follow-up to the original MSI claw that failed to make much of a splash, these two mini PCs are referred to as a "refresh" -- but they seem to be more than just that. The consoles, apart from updated specs, get a few design changes too. The downside? The flagship is significantly heavier.

We got our first look at the new Claw during this year's Computex, but that was before we knew the full specs. Now, MSI has revealed pretty much every spec for the two handhelds.

Read more
An AI robot’s painting was just auctioned for more than $1 million
Ai-Da beside its painting of Alan Turing.

A painting of British computer scientist and codebreaker Alan Turing that was created by an AI-powered robot has fetched $1.08 million at auction.

The astonishing amount marks a record sale for a piece of art created by a humanoid robot, and is sure to provoke discussion about the effect AI is having on art and how it is created.

Read more