GETReason: Enhancing Image Context Extraction through Hierarchical Multi-Agent Reasoning
This work addresses the need for accurate image context extraction in journalism and education, though it appears incremental as it builds on existing methods with a new framework and metric.
The paper tackles the problem of extracting deeper contextual meaning from publicly significant images, which existing methods struggle with, by introducing the GETReason framework and demonstrating that it can effectively link images to their broader event context.
Publicly significant images from events hold valuable contextual information, crucial for journalism and education. However, existing methods often struggle to extract this relevance accurately. To address this, we introduce GETReason (Geospatial Event Temporal Reasoning), a framework that moves beyond surface-level image descriptions to infer deeper contextual meaning. We propose that extracting global event, temporal, and geospatial information enhances understanding of an image's significance. Additionally, we introduce GREAT (Geospatial Reasoning and Event Accuracy with Temporal Alignment), a new metric for evaluating reasoning-based image understanding. Our layered multi-agent approach, assessed using a reasoning-weighted metric, demonstrates that meaningful insights can be inferred, effectively linking images to their broader event context.