CLIRMay 10

Skill-Contracted Agents for Evidence-Aware Materials Literature Analysis

arXiv:2607.20431
Originality Incremental advance
AI Analysis

For materials scientists, this work improves LLM-based literature analysis by explicitly separating retrieval and generation tasks, though the gains are demonstrated on a specific domain and dataset.

AlphaAgent, a skill-contracted agent framework, decouples retrieval-based QA from report generation for materials literature analysis, outperforming a baseline system on 40 materials-science questions with largest gains in mechanistic explanation and credibility awareness.

Materials science literature analysis requires simultaneous attention to composition, processing, characterization, and property relationships, yet conventional retrieval-augmented generation pipelines struggle to reconcile heterogeneous tasks within a single retrieve-then-generate architecture. Here we present AlphaAgent, a skill-driven agent framework that decouples retrieval-based question answering from paper-level report generation through explicit skill contracts. A dedicated retrieval skill rewrites user requests into material-specific search intents, queries a curated index of more than 300,000 papers from the Journal Citation Reports Metallurgy and Metallurgical Engineering category, and reformulates queries when initial evidence is insufficient. A separate report-generation skill parses full-text PDFs to produce structured per-paper analytical reports and cross-paper summaries. In a blind evaluation on 40 materials-science questions, half of which required deep analytical reasoning, AlphaAgent substantially outperformed a baseline system matched for underlying model, document index, and retrieval scale, with the largest gains in mechanistic explanation and awareness of credibility boundaries. These results indicate that explicit task separation, refined retrieval intent, and evidence-aware generation improve large-language-model-based literature analysis for materials research.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes