CVAIJul 6

Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation

arXiv:2607.0538210.6
Predicted impact top 36% in CV · last 90 daysOriginality Incremental advance
AI Analysis

For practitioners of visual generation, this work identifies and addresses the structural knowledge bottleneck caused by fixed training data, enabling models to handle open-ended user requests.

Visual generators fail on long-tail, evolving user requests due to a fixed training corpus. The authors construct SearchGen-20K and SearchGen-Bench, where frontier models score only 21-28/100, and propose a teach-then-search co-training framework that yields monotonic improvement, enabling agentic visual generation to handle unbounded world knowledge.

Visual generators excel at rendering, but they confidently fabricate what they do not know. User requests are unbounded, evolving, and deeply long-tailed: new characters, trending entities, post-cutoff events, and more. This world-knowledge bottleneck is structural: generators are trained on fixed corpora, but the visual world is open-ended. We construct SearchGen-20K and SearchGen-Bench, with 20,839 prompts spanning twelve failure categories and twenty-two domains, paired with a pre-executed multimodal SearchGen-Corpus-1M to support offline, reproducible research. On SearchGen-Bench, frontier open generators score only 21 to 28 out of 100, a 40-point collapse invisible to existing benchmarks. The natural remedy is to employ search tools, enabling agentic visual generation. However, we find that naive search fails: it retrieves indiscriminately, injecting noise into prompts the generator already handles. We trace the root cause to a generator-specific, evolving knowledge boundary: the divide between what a generator can internalize through training and what must remain in external context. Although this boundary is hard to specify in advance, we show that it is discoverable through a teach-then-search co-training framework. Even a minimal version of this co-training recipe produces monotonic improvement, laying the foundation for recursive self-improvement in visual generation that can meet world-knowledge-grounded requests. We release the full dataset, co-training corpus, and search corpus as a replayable harness for tool-augmented, world-knowledge-grounded visual generation.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes