DreamLLM-3D: Affective Dream Reliving using Large Language Model and 3D Generative AI
This work addresses the problem of dream reliving for individuals seeking to gain personal insights and enhance creativity through an immersive experience.
The authors tackled the problem of dream reliving by developing DreamLLM-3D, a system that enables automated dream content analysis for immersive dream-reliving, resulting in a potentially more emotionally engaging experience. The system integrates a Large Language Model with text-to-3D Generative AI to visualize dream entities as dynamic 3D point clouds.
We present DreamLLM-3D, a composite multimodal AI system behind an immersive art installation for dream re-experiencing. It enables automated dream content analysis for immersive dream-reliving, by integrating a Large Language Model (LLM) with text-to-3D Generative AI. The LLM processes voiced dream reports to identify key dream entities (characters and objects), social interaction, and dream sentiment. The extracted entities are visualized as dynamic 3D point clouds, with emotional data influencing the color and soundscapes of the virtual dream environment. Additionally, we propose an experiential AI-Dreamworker Hybrid paradigm. Our system and paradigm could potentially facilitate a more emotionally engaging dream-reliving experience, enhancing personal insights and creativity.