Exploring Decision-Making Capabilities of LLM Agents: An Experimental Study on Jump-Jump Game
This is an incremental study focusing on a specific domain (casual games) for AI researchers interested in LLM agent capabilities.
The paper tackles the problem of evaluating LLM decision-making capabilities by using the Jump-Jump game as a test environment, which involves spatial reasoning and strategic planning, but no concrete results or numbers are provided in the abstract.
The Jump-Jump game, as a simple yet challenging casual game, provides an ideal testing environment for studying LLM decision-making capabilities. The game requires players to precisely control jumping force based on current position and target platform distance, involving multiple cognitive aspects including spatial reasoning, physical modeling, and strategic planning. It illustrates the basic gameplay mechanics of the Jump-Jump game, where the player character (red circle) must jump across platforms with appropriate force to maximize score.