Xbox has built an AI model that can generate ‘video game visuals and actions’
The new model was partly trained on 2022’s Bleeding Edge
Microsoft has debuted a generative AI model that it says can generate “game visuals, controller actions, or both.”
This generative AI model, which Microsoft has named Muse, was developed by Microsoft’s Game intelligence team in collaboration with Ninja Theory. It will be made open source to help other researchers explore these models and build on their work, Microsoft said.
On Wednesday, Microsoft published several videos showing what gameplay sequences generated by Muse could look like. The company said these examples were generated by prompting the model with 10 initial frames (1 second) of human gameplay and the controller actions of the whole play sequence.
The footage was trained using Ninja Theory’s 2020 hero shooter Bleeding Edge.
“In our research, we focus on exploring the capabilities that models like Muse need to effectively support human creatives,” reads a post on the Microsoft website from Katja Hofmann, the senior principal research manager and lead of the Microsoft research game intelligence team.
“I’m incredibly proud of our teams and the milestone we have achieved, not only by showing the rich structure of the game world that a model like Muse can learn, as you see in the video demo below, but also, and even more importantly, by demonstrating how to develop research insights to support creative uses of generative AI models.”
Using one second of real gameplay, the model generated basic movement and geometry and recognizable character models. An in-depth report on the new model is available on Nature.
Generative AI has been a hot topic in the games industry in recent years, with concerns about generative AI leading to job losses, and potential plagiarism.
Take-Two Interactive CEO Strauss Zelnick recently said that not only does he think AI won’t lead to job losses, he believes it could lead to increased employment. He also said that he couldn’t think of any new guardrails that might be required to protect developers.
