Meta is advancing ahead of Apple in integrating AI into VR technology. While Bloomberg’s Mark Gurman noted that Apple Vision Pro will incorporate Apple Intelligence sometime after this year, Meta’s Quest headsets are set to receive AI capabilities next month.
Leveraging the Meta AI Assistant already integrated into Ray-Ban smart glasses, Meta AI with Vision on Meta Quest will enable users to ask questions based on what they can see through the device’s full-color passthrough cameras. Initially, this feature will be available on Quest 3 and Quest Pro devices, but Meta has hinted that the AI might eventually recognize objects using the more basic sensors of Quest 2.
Meta suggests that users could use the AI to complete outfits by analyzing what they’re wearing. A promotional video showed the headset identifying a dog even as it moved in and out of the frame. The AI can also answer general questions, like recommending nearby restaurants or quoting famous lines from Hamlet. Additionally, Meta AI can utilize Bing to search for live data online, making it more versatile than relying solely on its training data.
Meta AI with Vision employs multimodal technology, allowing it to process inputs from various mediums and translate content between them. However, Meta recently announced that it would not release its next multimodal model in the EU, so these AI features will first be available only in Canada and the United States, and will initially support English.
Despite this limited initial rollout, Meta is fully committed to the AI assistant, stating that “Meta AI will replace the current Voice Commands on Quest.” This suggests that the AI will also assist in controlling the headset, though the full extent of this capability is yet to be detailed.
Meta AI will launch on Quest in an experimental mode. To try it once it’s available, users need to open the settings menu on their headset and enable it under the “Experimental” submenu.
Povezani članci
Pico to Unveil New XR Product on August 20th in Special Event
Netflix Removes Its App from Quest Store: What This Means for Users