Evolving Multimodal Networks for Multitask Games

This is an Accepted Manuscript of a conference paper published by IEEE.Schrum, J., & Miikkulainen, R. (2011). Evolving multimodal networks for multitask games. In 2011 IEEE Conference on Computational Intelligence and Games (CIG’11) (pp. 102–109). https://doi.org/10.1109/CIG.2011.6031995. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.")

Schrum, Jacob

Miikkulainen, Risto

2016-12-13

2016-12-13

2011

Schrum, J., & Miikkulainen, R. (2011). Evolving multimodal networks for multitask games. In 2011 IEEE Conference on Computational Intelligence and Games (CIG’11) (pp. 102–109). https://doi.org/10.1109/CIG.2011.6031995

https://collections.southwestern.edu/s/suscholar/item/228

Intelligent opponent behavior helps make video games interesting to human players. Evolutionary computation can discover such behavior, especially when the game consists of a single task. However, multitask domains, in which separate tasks within the domain each have their own dynamics and objectives, can be challenging for evolution. This paper proposes two methods for meeting this challenge by evolving neural networks: 1) Multitask Learning provides a network with distinct outputs per task, thus evolving a separate policy for each task, and 2) Mode Mutation provides a means to evolve new output modes, as well as a way to select which mode to use at each moment. Multitask Learning assumes agents know which task they are currently facing; if such information is available and accurate, this approach works very well, as demonstrated in the Front/Back Ramming game of this paper. In contrast, Mode Mutation discovers an appropriate task division on its own, which may in some cases be even more powerful than a human-specified task division, as shown in the Predator/Prey game of this paper. These results demonstrate the importance of both Multitask Learning and Mode Mutation for learning intelligent behavior in complex games.

English

IEEE

Computer games

Evolutionary computation

Approximation methods

Multimodal networks

Multitask games

Multitask Learning

Mode Mutation

Article