Evaluating In Silico Creativity: An Expert Review of AI Chess Compositions
This addresses the problem of evaluating AI creativity in specific domains like chess, though it appears incremental as it applies existing methods to a new task.
The study investigated AI's ability to generate creative chess puzzles, with an expert review by three world-renowned chess masters finding that the AI-produced puzzles were characterized by aesthetic appeal, novelty, and unique solutions.
The rapid advancement of Generative AI has raised significant questions regarding its ability to produce creative and novel outputs. Our recent work investigates this question within the domain of chess puzzles and presents an AI system designed to generate puzzles characterized by aesthetic appeal, novelty, counter-intuitive and unique solutions. We briefly discuss our method below and refer the reader to the technical paper for more details. To assess our system's creativity, we presented a curated booklet of AI-generated puzzles to three world-renowned experts: International Master for chess compositions Amatzia Avni, Grandmaster Jonathan Levitt, and Grandmaster Matthew Sadler. All three are noted authors on chess aesthetics and the evolving role of computers in the game. They were asked to select their favorites and explain what made them appealing, considering qualities such as their creativity, level of challenge, or aesthetic design.