A Novel mapping for visual to auditory sensory substitution
This work addresses sensory substitution for visually impaired individuals, offering an incremental improvement over existing methods.
The paper tackles the problem of converting visual information into audio streams for visually impaired people by mapping visual environmental features to musical audio features, achieving 88.05% average accuracy in blind object recognition and improved training time efficiency compared to a previous method.
visual information can be converted into audio stream via sensory substitution devices in order to give visually impaired people the chance of perception of their surrounding easily and simultaneous to performing everyday tasks. In this study, visual environmental features namely, coordinate, type of objects and their size are assigned to audio features related to music tones such as frequency, time duration and note permutations. Results demonstrated that this new method has more training time efficiency in comparison with our previous method named VBTones which sinusoidal tones were applied. Moreover, results in blind object recognition for real objects was achieved 88.05 on average.