SOV-CAD: Stepwise Orthographic Views Guided CAD Modeling Sequence Reconstruction
For CAD reconstruction from images, SOV-CAD provides a more human-like and accurate approach by incorporating iterative visual feedback, outperforming prior holistic methods.
SOV-CAD introduces stepwise orthographic views as visual feedback to reconstruct CAD modeling sequences from images, achieving state-of-the-art accuracy and data efficiency.
Reconstructing Computer-Aided Design (CAD) modeling sequences from images is crucial for preserving design intent and supporting parametric editing. However, existing methods typically generate full CAD sequences holistically, overlooking the iterative, feedback-driven nature of human design workflows. We address this limitation by introducing the rich stepwise visual supervision: at each modeling step, the system observes the target's orthographic projections, the projections of the incrementally constructed model, and the active sketch, enabling informed action selection. To effectively leverage this on-the-fly feedback, we propose SOV-CAD, a framework that formulates CAD reconstruction as a sequential decision-making task and employs offline reinforcement learning with a Decision Transformer architecture. This design incorporates continuous visual feedback guided by geometric alignment rewards, resulting in a more accurate and human-like modeling process. Extensive experiments show that SOV-CAD surpasses state-of-the-art methods in CAD sequence reconstruction while exhibiting strong data efficiency. Code of SOV-CAD is available at: https://github.com/LukePhong/SOV-CAD