Comparing Direct and Indirect Encodings Using Both Raw and Hand-Designed Features in Tetris

Title

Comparing Direct and Indirect Encodings Using Both Raw and Hand-Designed Features in Tetris

Creator

Schrum, Jacob

Gillespie, Lauren E.

Gonzalez, Gabriela R.

Date

2018-12-10

Date Available

2018-12-10

Date Issued

2017-07

Identifier

Lauren E. Gillespie, Gabriela R. Gonzalez, and Jacob Schrum. 2017. Comparing direct and indirect encodings using both raw and hand-designed features in tetris. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '17). ACM, New York, NY, USA, 179-186. DOI: https://doi.org/10.1145/3071178.3071195

uri

https://collections.southwestern.edu/s/suscholar/item/242

Abstract

Intelligent agents have a wide range of applications in robotics, video games, and computer simulations. However, fully general agents should function with as little human guidance as possible. Specifically, agents should learn from large collections of raw state variables instead of small collections of hand-designed features. Learning from raw state variables is difficult, but can be easier when agents are aware of the geometry of the input space. Indirect encodings allow agents to take advantage of the geometry of the task, and scale up to large input spaces. This research demonstrates the relative benefits of a direct and indirect encoding using raw or hand-designed features in Tetris, a challenging video game. Specifically, the direct encoding NEAT is compared against the indirect encoding HyperNEAT Both algorithms create neural networks to play the game, but HyperNEAT makes better use of raw screen inputs, due to its ability to generate large networks that take advantage of the domain's geometry. However, hand-designed features lead to higher scores with both algorithms. HyperNEAT makes better use of hand-designed features early in evolution, but NEAT eventually overtakes it. Since each method succeeds in different circumstances, approaches combining the strengths of both should be explored.

Language

English

Publisher

Proceedings of the Genetic and Evolutionary Computation Conference

Subject

Computing methodologies

Machine learning

Machine learning approaches

Neural networks

Bio-inspired approaches

Generative and developmental approaches

Type

Article