Microsft CEO confirms that Xbox Muse is scheduled with a training based on a catalog of games

In a groundbreaking move, Microsoft CEO Satya Nadella has revealed that the company plans to train its new AI system, Muse, on a catalog of video games. This announcement was made during an interview on the Dwarkesh Patel Podcast, where Nadella expressed his excitement about the potential of this technology to revolutionize the gaming industry.

Muse is a generative AI model designed to assist with game ideation, development, and preservation. Unlike traditional AI models, Muse can generate gameplay footage based on user input, creating a dynamic and interactive experience. Nadella described seeing Muse in action as a “massive, massive moment of ‘wow’,” comparing it to the first time he saw other generative AI models like ChatGPT and DALL-E.

Muse has been trained on years of gameplay footage from Ninja Theory’s arena shooter, Bleeding Edge. By ingesting this extensive archive, Muse can generate new gameplay footage and adapt it based on specific prompts from users. For example, if a user suggests adding a jump pad to a level, Muse can generate gameplay footage that incorporates this change.

Nadella emphasized that Muse is not yet capable of coding its own games or creating entirely new concepts. Instead, it serves as a tool to speed up the development process by providing generated gameplay footage. This capability could be particularly useful for game developers looking to quickly prototype and iterate on new ideas.

Potential Impact on the Gaming Industry

The introduction of Muse has sparked a range of reactions within the gaming community. Some experts, like gaming AI specialist Michael Cook, have praised the technology’s ability to handle complex visual information, such as lighting and camera angles. However, others remain skeptical about its practical applications.

Nadella also highlighted the potential for Muse to assist with game preservation, ensuring that classic titles remain accessible and playable for future generations. This aspect of Muse could be a game-changer for the industry, providing a new way to maintain and celebrate gaming history.

Microsoft’s decision to train its new AI on a catalog of games marks a significant step forward in the integration of AI technology within the gaming industry. While there are still many questions about how Muse will be used and its long-term impact, the excitement and potential surrounding this innovation are undeniable. As Nadella put it, this is just the beginning of what could be a transformative journey for both game developers and players alike.