Spike Imaging Velocimetry: Dense Motion Estimation of Fluids Using Spike Cameras
This addresses the need for non-intrusive flow measurement in fluid dynamics, offering an incremental improvement over traditional Particle Image Velocimetry with enhanced capabilities for complex scenarios.
The study tackled the problem of accurate motion estimation in turbulent fluid flows by proposing Spike Imaging Velocimetry (SIV), a deep learning framework using spike cameras, which achieved superior performance on a new dataset compared to existing methods.
The need for accurate and non-intrusive flow measurement methods has led to the widespread adoption of Particle Image Velocimetry (PIV), a powerful diagnostic tool in fluid motion estimation. This study investigates the tremendous potential of spike cameras (a type of ultra-high-speed, high-dynamic-range camera) in PIV. We propose a deep learning framework, Spike Imaging Velocimetry (SIV), designed specifically for highly turbulent and intricate flow fields. To aggregate motion features from the spike stream while minimizing information loss, we incorporate a Detail-Preserving Hierarchical Transform (DPHT) module. Additionally, we introduce a Graph Encoder (GE) to extract contextual features from highly complex fluid flows. Furthermore, we present a spike-based PIV dataset, Particle Scenes with Spike and Displacement (PSSD), which provides labeled data for three challenging fluid dynamics scenarios. Our proposed method achieves superior performance compared to existing baseline methods on PSSD. The datasets and our implementation of SIV are open-sourced in the supplementary materials.