Unrolling Virtual Worlds for Immersive Experiences
This work addresses the problem of creating coherent virtual environments for immersive experiences, but it appears incremental as it builds on existing text-to-image and inpainting techniques.
The research tackled generating immersive 3D worlds from 2D panoramas by addressing distortions in equirectangular projections, using an inpainting-like method to enable smooth scene construction.
This research pioneers a method for generating immersive worlds, drawing inspiration from elements of vintage adventure games like Myst and employing modern text-to-image models. We explore the intricate conversion of 2D panoramas into 3D scenes using equirectangular projections, addressing the distortions in perception that occur as observers navigate within the encompassing sphere. Our approach employs a technique similar to "inpainting" to rectify distorted projections, enabling the smooth construction of locally coherent worlds. This provides extensive insight into the interrelation of technology, perception, and experiential reality within human-computer interaction.