Tag Archives: Xbox Muse

Microsft CEO confirms that Xbox Muse is scheduled with a training based on a catalog of games

In a groundbreaking move, Microsoft CEO Satya Nadella has revealed that the company plans to train its new AI system, Muse, on a catalog of video games. This announcement was made during an interview on the Dwarkesh Patel Podcast, where Nadella expressed his excitement about the potential of this technology to revolutionize the gaming industry.

Muse is a generative AI model designed to assist with game ideation, development, and preservation. Unlike traditional AI models, Muse can generate gameplay footage based on user input, creating a dynamic and interactive experience. Nadella described seeing Muse in action as a “massive, massive moment of ‘wow’,” comparing it to the first time he saw other generative AI models like ChatGPT and DALL-E.

Muse has been trained on years of gameplay footage from Ninja Theory’s arena shooter, Bleeding Edge. By ingesting this extensive archive, Muse can generate new gameplay footage and adapt it based on specific prompts from users. For example, if a user suggests adding a jump pad to a level, Muse can generate gameplay footage that incorporates this change.

Nadella emphasized that Muse is not yet capable of coding its own games or creating entirely new concepts. Instead, it serves as a tool to speed up the development process by providing generated gameplay footage. This capability could be particularly useful for game developers looking to quickly prototype and iterate on new ideas.

Potential Impact on the Gaming Industry

The introduction of Muse has sparked a range of reactions within the gaming community. Some experts, like gaming AI specialist Michael Cook, have praised the technology’s ability to handle complex visual information, such as lighting and camera angles. However, others remain skeptical about its practical applications.

Nadella also highlighted the potential for Muse to assist with game preservation, ensuring that classic titles remain accessible and playable for future generations. This aspect of Muse could be a game-changer for the industry, providing a new way to maintain and celebrate gaming history.

Microsoft’s decision to train its new AI on a catalog of games marks a significant step forward in the integration of AI technology within the gaming industry. While there are still many questions about how Muse will be used and its long-term impact, the excitement and potential surrounding this innovation are undeniable. As Nadella put it, this is just the beginning of what could be a transformative journey for both game developers and players alike.

Xbox Muse is the start of serious AI use in gaming preservation and re-development

Microsoft has recently unveiled an exciting new development in the gaming world: Xbox Muse, a generative AI model designed to revolutionize game ideation and preservation. Developed in collaboration with Xbox Game Studios’ Ninja Theory, Muse is a groundbreaking tool that leverages real player inputs to create gameplay sequences.

What is Xbox Muse?

Xbox Muse, short for World and Human Action Model (WHAM), is a generative AI model trained using data from Ninja Theory’s multiplayer battle arena game, Bleeding Edge. The model can generate both game visuals and controller actions, providing a detailed understanding of the 3D game world, including game physics and player interactions.

How Does Xbox Muse Work?

Muse was trained using anonymized data from 500,000 play sessions of Bleeding Edge. This extensive dataset allows the AI to simulate realistic gameplay sequences, demonstrating a significant step towards generative AI models that can empower game creators2. The model can generate gameplay visuals at a resolution of 300×180 pixels, a considerable improvement over previous models.

Potential Applications of Xbox Muse

One of the most exciting aspects of Xbox Muse is its potential to revive nostalgic games that are no longer playable on modern hardware. By leveraging AI technology, developers can port old games to new platforms, making them accessible to future generations of players2. This not only preserves gaming history but also opens up new creative possibilities for game developers.

Microsoft plans to discuss AI experiences from Xbox in greater detail at the Game Developers Conference (GDC) 2025. Additionally, the company aims to make a series of AI-powered game experiences available on its Copilot Labs website, where subscribers can access various experimental AI features.

Xbox Muse represents a significant advancement in the intersection of AI and gaming. By harnessing the power of generative AI, Microsoft is paving the way for innovative game development and the preservation of classic games. As we look forward to more updates from Microsoft, the gaming community eagerly anticipates the exciting possibilities that Xbox Muse will bring.