Sensorium Arc: AI Agent System for Oceanic Data Exploration and Interactive Eco-Art
This work addresses the problem of intuitive access to environmental data for users interested in climate and art, proposing a new paradigm for human-machine-ecosystem interaction.
The paper tackles the challenge of making complex marine data accessible by developing Sensorium Arc, an AI agent system that personifies the ocean to guide users through immersive explorations, blending scientific insight with ecological poetics in real-time interactions.
Sensorium Arc (AI reflects on climate) is a real-time multimodal interactive AI agent system that personifies the ocean as a poetic speaker and guides users through immersive explorations of complex marine data. Built on a modular multi-agent system and retrieval-augmented large language model (LLM) framework, Sensorium enables natural spoken conversations with AI agents that embodies the ocean's perspective, generating responses that blend scientific insight with ecological poetics. Through keyword detection and semantic parsing, the system dynamically triggers data visualizations and audiovisual playback based on time, location, and thematic cues drawn from the dialogue. Developed in collaboration with the Center for the Study of the Force Majeure and inspired by the eco-aesthetic philosophy of Newton Harrison, Sensorium Arc reimagines ocean data not as an abstract dataset but as a living narrative. The project demonstrates the potential of conversational AI agents to mediate affective, intuitive access to high-dimensional environmental data and proposes a new paradigm for human-machine-ecosystem.