Hacking Nonverbal Communication Between Pedestrians and Vehicles in Virtual Reality
This research addresses the problem of understanding and improving pedestrian-vehicle communication for safety and autonomous vehicle design, though it is incremental as it builds on existing work in social cues and VR studies.
The study investigated how pedestrians interpret vehicle trajectories as social cues by engineering 15 trajectories that either followed or broke social conventions, using a virtual reality environment with 22 subjects. Results showed that pedestrians use vehicle kinematics to infer social intentions, not just as moving objects, and that social cues can be engineered through trajectory manipulation.
We use an immersive virtual reality environment to explore the intricate social cues that underlie non-verbal communication involved in a pedestrian's crossing decision. We "hack" non-verbal communication between pedestrian and vehicle by engineering a set of 15 vehicle trajectories, some of which follow social conventions and some that break them. By subverting social expectations of vehicle behavior we show that pedestrians may use vehicle kinematics to infer social intentions and not merely as the state of a moving object. We investigate human behavior in this virtual world by conducting a study of 22 subjects, with each subject experiencing and responding to each of the trajectories by moving their body, legs, arms, and head in both the physical and the virtual world. Both quantitative and qualitative responses are collected and analyzed, showing that, in fact, social cues can be engineered through vehicle trajectory manipulation. In addition, we demonstrate that immersive virtual worlds which allow the pedestrian to move around freely, provide a powerful way to understand both the mechanisms of human perception and the social signaling involved in pedestrian-vehicle interaction.