Can Multisensory Cues in VR Help Train Pattern Recognition to Citizen Scientists?
This is incremental research exploring the potential of multisensory VR for improving training in citizen science, specifically for water monitoring tasks.
The paper tackles the problem of whether multisensory cues in VR can enhance realism, immersion, and knowledge transfer for training citizen scientists in water monitoring, with the development of StreamBED as a VR platform to investigate this, but no concrete results or numbers are provided as it describes future work.
As the internet of things (IoT) has integrated physical and digital technologies, designing for multiple sensory media (mulsemedia) has become more attainable. Designing technology for multiple senses has the capacity to improve virtual realism, extend our ability to process information, and more easily transfer knowledge between physical and digital environments. HCI researchers are beginning to explore the viability of integrating multimedia into virtual experiences, however research has yet to consider whether mulsemedia truly enhances realism, immersion and knowledge transfer. My work developing StreamBED, a VR training platform to train citizen science water monitors plans to consider the role of mulsemedia in immersion and learning goals. Future findings about the role of mulsemedia in learning contexts will potentially allow learners to experience, connect to, learn from spaces that are impossible to experience firsthand.