CVMar 8

DocCogito: Aligning Layout Cognition and Step-Level Grounded Reasoning for Document Understanding

arXiv:2603.07494v11 citations
Predicted impact top 7% in CV · last 90 daysOriginality Highly original
AI Analysis

This work addresses the problem of improving explicit, evidence-grounded reasoning in document MLLMs for high-stakes scenarios, which is crucial for reliable document understanding.

This paper introduces DocCogito, a unified framework for document understanding with multimodal large language models (MLLMs) that integrates global layout perception with structured, region-grounded reasoning. It achieves state-of-the-art results on four out of six benchmarks, demonstrating strong generalization.

Document understanding with multimodal large language models (MLLMs) requires not only accurate answers but also explicit, evidence-grounded reasoning, especially in high-stakes scenarios. However, current document MLLMs still fall short of forming a complete, human-like reasoning process, because even when they improve both layout encoding and CoT-style prompting, the interaction between the two is typically learned implicitly and remains loosely coupled rather than being enforced as a systematic mechanism. So we propose DocCogito, a unified framework that integrates global layout perception with structured, region-grounded reasoning. DocCogito introduces a lightweight layout tower that distills page structure into learnable global layout prior tokens, and a deterministic Visual-Semantic Chain (VSC)-a concise structured representation less ambiguous than free-form natural-language CoT-to supervise fine-grained intermediate reasoning aligned with evidence regions. Training follows a progressive recipe, including layout perception pretraining, VSC-guided cold start, rejection sampling, and GRPO. To further strengthen the internal coupling between layout priors and VSC execution, we augment standard rewards with a fine-grained region-confidence signal that encourages reasoning traces to stay aligned with corresponding evidence regions. Extensive experiments on six benchmarks (DocVQA, WTQ, ChartQA, TextVQA, OCRBench, and InfoVQA) demonstrate strong generalization, achieving state-of-the-art results on four benchmarks.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes