Setting SAIL: Leveraging Scientist-AI-Loops for Rigorous Visualization Tools
This addresses the problem for scientists who need efficient, accurate interactive visualization tools but face risks from AI-generated code, though it is incremental as it builds on existing AI code generation methods.
The paper tackles the challenge of using AI for scientific tool development without compromising accuracy by introducing the Scientist-AI-Loop (SAIL) framework, which separates domain logic from code to enable rapid development while maintaining scientific integrity, as demonstrated by creating two astrophysics tools in days.
Scientists across all disciplines share a common challenge: the divide between their theoretical knowledge and the specialized skills and time needed to build interactive tools to communicate this expertise. While large language models (LLMs) offer unparalleled acceleration in code generation, they frequently prioritize functional syntax over scientific accuracy, risking visually convincing but scientifically invalid results. This work advocates the Scientist-AI-Loop (SAIL), a framework designed to harness this speed without compromising rigor. By separating domain logic from code syntax, SAIL enables researchers to maintain strict oversight of scientific concepts and constraints while delegating code implementation to AI. We illustrate this approach through two open-source, browser-based astrophysics tools: an interactive gravitational lensing visualization and a large-scale structure formation sandbox, both publicly available. Our methodology condensed development to mere days while maintaining scientific integrity. We specifically address failure modes where AI-generated code neglects phenomenological boundaries or scientific validity. While cautioning that research-grade code requires stringent protocols, we demonstrate through two examples that SAIL provides an effective code generation workflow for outreach, teaching, professional presentations, and early-stage research prototyping. This framework contributes to a foundation for the further development of AI-assisted scientific software.