MetaDecorator: Generating Immersive Virtual Tours through Multimodality
This addresses the need for more immersive and customizable virtual reality experiences for users, though it appears incremental as it builds on existing image synthesis techniques.
The paper tackles the problem of personalizing virtual tours by developing MetaDecorator, a framework that uses text prompts and image synthesis to style static panoramas, resulting in enhanced realism and engagement compared to traditional methods.
MetaDecorator, is a framework that empowers users to personalize virtual spaces. By leveraging text-driven prompts and image synthesis techniques, MetaDecorator adorns static panoramas captured by 360° imaging devices, transforming them into uniquely styled and visually appealing environments. This significantly enhances the realism and engagement of virtual tours compared to traditional offerings. Beyond the core framework, we also discuss the integration of Large Language Models (LLMs) and haptics in the VR application to provide a more immersive experience.