Microsoft Copilot AI provides hints in PC and Xbox games like Minecraft

Put simply: Assistance with various tasks is one of the main features of generative AI proposed by companies such as Microsoft, OpenAI, Google, and perhaps soon Apple. Microsoft recently announced its “AI PC” and claimed that its AI, Copilot, can assist players of certain video games in real time, but its effectiveness in real-world scenarios remains to be seen.

meanwhile reveal Microsoft announced its new AI-powered Surface laptop this week and shared a demo of the device’s Copilot onboard AI providing real-time hints in games like Minecraft and Sea of ​​Thieves. His fully voiced digital assistant appeared to have natural conversations and react to in-game events.

In one video, a Minecraft player asks Copilot how to make a sword. The AI ​​will check what items the player has in their inventory and suggest that they should collect wood or stone. In another video, zombies attack players. Copilot quickly switches to a wary tone, advising the player to find shelter or build a barrier out of the zombies’ reach.

Real-time conversations with Copilot, an AI companion powered by OpenAI’s GPT-4o. pic.twitter.com/Ug7EWv2sah

– Microsoft Copilot (@MSFTCopilot) May 20, 2024

It’s unclear which games Copilot will support, but here are some screenshots from Windows Central: suggest Also useful for Sea of ​​Thieves. If the AI ​​needs to be tuned for each game, it could debut for specific titles published by Microsoft.

Microsoft emphasized its focus on privacy, saying that any information Copilot collects for in-game assistance will remain on the device. The company does not upload the data to the cloud or use it to train AI models.

Real-time guides are somewhat different from other AI-based applications for video games. The most successful gaming-related use of this technology has been machine learning-assisted upscaling and frame generation, features that dramatically improve performance. On the other hand, Nvidia was suggested Fill the game with AI-controlled characters that can react to a wide range of player inputs.

On the contrary, in-game assistance is likely to be optional and has no direct impact on the content of the game. However, some may express concerns about the effect of this feature on handwritten guides.

Hallucinations are also a risk to consider. So far, developers have not been successful in stopping AI-based chatbots from confidently stating false information. The recently announced Her AI Summary for Google Search was immediately hallucinated, so there’s a good chance the same thing will happen with Copilot’s game Her Assistant.

Microsoft’s Surface Pro Copilot PC will begin shipping in mid-June, starting at $999.99. This PC uses Qualcomm’s Snapdragon X Elite processor and runs an Arm-based version of Windows. Hexagon NPU runs AI workloads at 45 TOP.