SideSeeing: A multimodal dataset and collection of tools for sidewalk assessment
This provides urban experts with tools for sidewalk accessibility evaluations, though it is incremental in building on existing data collection methods.
The paper introduces SideSeeing, a framework and dataset for sidewalk assessment, integrating synchronized video and sensor data from chest-mounted devices covering 12 kilometers and 325,000 frames around hospitals in Brazil and the USA.
This paper introduces SideSeeing, a novel initiative that provides tools and datasets for assessing the built environment. We present a framework for street-level data acquisition, loading, and analysis. Using the framework, we collected a novel dataset that integrates synchronized video footaged captured from chest-mounted mobile devices with sensor data (accelerometer, gyroscope, magnetometer, and GPS). Each data sample represents a path traversed by a user filming sidewalks near hospitals in Brazil and the USA. The dataset encompasses three hours of content covering 12 kilometers around nine hospitals, and includes 325,000 video frames with corresponding sensor data. Additionally, we present a novel 68-element taxonomy specifically created for sidewalk scene identification. SideSeeing is a step towards a suite of tools that urban experts can use to perform in-depth sidewalk accessibility evaluations. SideSeeing data and tools are publicly available at https://sites.usp.br/sideseeing/.