Muse by Microsoft

Muse by Microsoft is a generative AI model that generates video game visuals and controller actions, developed by the Microsoft Research Game Intelligence and Teachable AI Experiences teams in collaboration with Xbox Games Studios’ Ninja Theory. The model is designed to support human creatives in game development. Muse is based on the World and Human Action Model (WHAM) and can generate complex gameplay sequences that are consistent over several minutes.
The WHAM model is a key component of Muse, allowing it to learn the dynamics of a game and generate new gameplay sequences. The model is trained on large amounts of data and can be used in various modes, including world model mode, to predict how a game will evolve from an initial prompt sequence.
Game developers and researchers can get the most value from Muse by Microsoft, as it enables them to build on the work and explore new creative use cases with the WHAM Demonstrator on Azure AI Foundry. This can help them to develop new game ideas, test game mechanics, and improve overall game quality.