The Effect of Computer-Generated Descriptions on Photo-Sharing Experiences of People with Visual Impairments
This addresses photo-sharing challenges for visually impaired people, but is incremental as it builds on existing technology and focuses on a specific domain.
The study tackled the problem of visually impaired people struggling to share photos on social media by integrating computer-generated descriptions into Facebook's photo-sharing feature, finding that participants used descriptions for recall and organization but hesitated to upload without sighted input.
Like sighted people, visually impaired people want to share photographs on social networking services, but find it difficult to identify and select photos from their albums. We aimed to address this problem by incorporating state-of-the-art computer-generated descriptions into Facebook's photo-sharing feature. We interviewed 12 visually impaired participants to understand their photo-sharing experiences and designed a photo description feature for the Facebook mobile application. We evaluated this feature with six participants in a seven-day diary study. We found that participants used the descriptions to recall and organize their photos, but they hesitated to upload photos without a sighted person's input. In addition to basic information about photo content, participants wanted to know more details about salient objects and people, and whether the photos reflected their personal aesthetics. We discuss these findings from the lens of self-disclosure and self-presentation theories and propose new computer vision research directions that will better support visual content sharing by visually impaired people.