Image-to-Level: Generation and Repair

Procedural content generation via machine learning (PCGML) has recently gained research attention due to its ability to generate new game content with minimal user input. However, thus far those without machine learning expertise have been largely unable to use PCGML to generate content to fit their needs.

This paper proposes the use of images as the input for a PCGML process to generate game levels. Intuitively, a user can submit an image, with the system returning the closest valid Super Mario Bros. game level. Our results indicate that at least for domains like Super Mario Bros. we can recreate a target level with high fidelity.