[STEAM] Microsoft and Hellblade Developer Ninja Theory Built an AI Called Muse Designed to Generate Ideas for a Game's Design — and It’s Already Making 'Complex' Gameplay Sequences

[Steam 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up

has announced a new generative AI model designed for gameplay ideation.

The company detailed what it calls the first World and Human Action Model (WHAM). The WHAM, Katja Hofmann, Senior Principal Research Manager and lead of the

This is the hidden content, please

• Sign In
• or
• Sign Up

Research Game Intelligence team, said in a

This is the hidden content, please

• Sign In
• or
• Sign Up

, is a generative AI model of a video game that can generate game visuals, controller actions, or both.

This is the hidden content, please

• Sign In
• or
• Sign Up

calls this generative AI model Muse, which was developed by the

This is the hidden content, please

• Sign In
• or
• Sign Up

Research Game Intelligence and Teachable AI Experiences (**** X) teams in collaboration with Hellblade developer Ninja Theory. It’s open sourcing the weights and sample data and making the executable available for the WHAM Demonstrator — a concept prototype that provides a visual interface for interacting with WHAM models and multiple ways of prompting the models.

The company provided a number of gameplay clips showing what Muse is capable of. Currently, the model can generate “complex gameplay sequences that are consistent over several minutes” just by prompting the model with 10 initial frames (one second) of human gameplay and the controller actions of the whole play sequence.

The game used to train Muse was Ninja Theory’s 2020 multiplayer game

This is the hidden content, please

• Sign In
• or
• Sign Up

. “We worked closely with our colleagues at Ninja Theory and with

This is the hidden content, please

• Sign In
• or
• Sign Up

compliance teams to ensure that the data was collected ethically and used responsibly for research purposes,” Hofmann insisted.

“It’s been amazing to see the variety of ways

This is the hidden content, please

• Sign In
• or
• Sign Up

Research has used the Bleeding Edge environment and data to explore novel techniques in a rapidly moving AI industry,” said Gavin Costello, technical director at Ninja Theory.

“From the hackathon that started it all, where we first integrated AI into Bleeding Edge, to building AI agents that could behave more like human players, to the World and Human Action Model being able to dream up entirely new sequences of Bleeding Edge gameplay under human guidance, it’s been eye-opening to see the potential this type of technology has.”

Muse is used in “world model mode” meaning it is used to predict how the game will evolve from the initial prompt sequence. The more closely the generated gameplay sequence resembles the actual game, the more accurately Muse has captured the dynamics of that game.

Generative AI is one of the hottest and most controversial topics in the creative industries. As video game development costs rise, publishers are increasingly looking to AI tools to speed up work and cut costs.

This is the hidden content, please

• Sign In
• or
• Sign Up

in late 2023, and

This is the hidden content, please

• Sign In
• or
• Sign Up

. EA said in September that

This is the hidden content, please

• Sign In
• or
• Sign Up

, and just last month,

This is the hidden content, please

• Sign In
• or
• Sign Up

to create the "hundreds of thousands" of ideas needed for in-game environments.

Head of PlayStation Productions and head of product at PlayStation Studios Asad Qizilbash

This is the hidden content, please

• Sign In
• or
• Sign Up

who seek "personalization across everything."

"For instance, non-player characters in games could interact with players based on their actions, making it feel more personal,” Qizilbash said. “This is important for the younger Gen Z and Gen Alpha audiences, who are the first generations that grew up digitally and are looking for personalization across everything, as well as looking for experiences to have more meaning."

This is the hidden content, please

• Sign In
• or
• Sign Up

is all-in on generative AI, as anyone with even a cursory knowledge of ChatGPT and OpenAI will know, and so this development with Ninja Theory comes as little surprise. Still, the company will face tough questions from some within the video game development community who are worried models like Muse will put them out of a job.

In the blog post, Hofmann insisted that

This is the hidden content, please

• Sign In
• or
• Sign Up

's team “focus on exploring the capabilities that models like Muse need to effectively support human creatives.”

“I look forward to seeing the many ways in which the community will explore these models and build on our research," Hofmann continued. "I cannot wait to see all the ways that these models and subsequent research will help shape and increase our understanding of how generative AI models of human gameplay may support gameplay ideation and pave the way for future, novel, AI-based game experiences, including the use cases that our colleagues at Xbox have already started to explore.”

Wesley is the *** News Editor for IGN. Find him on

This is the hidden content, please

• Sign In
• or
• Sign Up

at @wyp100. You can reach Wesley at [email protected] or confidentially at *****@*****.tld.

This is the hidden content, please

• Sign In
• or
• Sign Up