PhotoAgent: A Robotic Photographer with Spatial and Aesthetic Understanding
This addresses the challenge for robotics and AI in creative tasks like photography, representing a novel method rather than an incremental improvement.
The paper tackles the problem of enabling embodied agents to perform photography by bridging high-level language commands with geometric control, resulting in PhotoAgent, which achieves superior final image quality through a novel integration of Large Multimodal Models and 3D Gaussian Splatting.
Embodied agents for creative tasks like photography must bridge the semantic gap between high-level language commands and geometric control. We introduce PhotoAgent, an agent that achieves this by integrating Large Multimodal Models (LMMs) reasoning with a novel control paradigm. PhotoAgent first translates subjective aesthetic goals into solvable geometric constraints via LMM-driven, chain-of-thought (CoT) reasoning, allowing an analytical solver to compute a high-quality initial viewpoint. This initial pose is then iteratively refined through visual reflection within a photorealistic internal world model built with 3D Gaussian Splatting (3DGS). This ``mental simulation'' replaces costly and slow physical trial-and-error, enabling rapid convergence to aesthetically superior results. Evaluations confirm that PhotoAgent excels in spatial reasoning and achieves superior final image quality.