Text2Arch: A Dataset for Generating Scientific Architecture Diagrams from Natural Language Descriptions
This work provides a much-needed dataset and baseline models for the task of generating scientific architecture diagrams from natural language, benefiting researchers and practitioners in enterprise architecture, AI-driven design, and education.
The authors introduce Text2Arch, a dataset for generating scientific architecture diagrams from text, and show that fine-tuned small language models on this dataset outperform existing baselines and match GPT-4o in-context learning performance.
Communicating complex system designs or scientific processes through text alone is inefficient and prone to ambiguity. A system that automatically generates scientific architecture diagrams from text with high semantic fidelity can be useful in multiple applications like enterprise architecture visualization, AI-driven software design, and educational content creation. Hence, in this paper, we focus on leveraging language models to perform semantic understanding of the input text description to generate intermediate code that can be processed to generate high-fidelity architecture diagrams. Unfortunately, no clean large-scale open-access dataset exists, implying lack of any effective open models for this task. Hence, we contribute a comprehensive dataset, \system, comprising scientific architecture images, their corresponding textual descriptions, and associated DOT code representations. Leveraging this resource, we fine-tune a suite of small language models, and also perform in-context learning using GPT-4o. Through extensive experimentation, we show that \system{} models significantly outperform existing baseline models like DiagramAgent and perform at par with in-context learning-based generations from GPT-4o. We make the code, data and models publicly available.