LabOS: The AI-XR Co-Scientist That Sees and Works With Humans
This addresses the challenge of bridging computational reasoning with hands-on laboratory work for scientists, representing a novel paradigm rather than an incremental improvement.
The paper tackles the problem of integrating AI into physical scientific experimentation by introducing LabOS, an AI co-scientist that uses multimodal perception and XR to collaborate with humans in real-time, resulting in applications like cancer immunotherapy target discovery and stem-cell engineering.
Modern science advances fastest when thought meets action. LabOS represents the first AI co-scientist that unites computational reasoning with physical experimentation through multimodal perception, self-evolving agents, and Entended-Reality(XR)-enabled human-AI collaboration. By connecting multi-model AI agents, smart glasses, and human-AI collaboration, LabOS allows AI to see what scientists see, understand experimental context, and assist in real-time execution. Across applications--from cancer immunotherapy target discovery to stem-cell engineering -- LabOS shows that AI can move beyond computational design to participation, turning the laboratory into an intelligent, collaborative environment where human and machine discovery evolve together.