Stereo Co-capture System for Recording and Tracking Fish with Frame- and Event Cameras
This work addresses the challenge of multi-animal tracking in biology, particularly for erratic fish movements, but it is incremental as it sets a baseline for further exploration.
The authors tackled the problem of capturing and tracking fast-moving fish by developing a co-capture system using both conventional and event cameras, resulting in a baseline event-based multi-animal tracking algorithm that demonstrates feasibility.
This work introduces a co-capture system for multi-animal visual data acquisition using conventional cameras and event cameras. Event cameras offer multiple advantages over frame-based cameras, such as a high temporal resolution and temporal redundancy suppression, which enable us to efficiently capture the fast and erratic movements of fish. We furthermore present an event-based multi-animal tracking algorithm, which proves the feasibility of the approach and sets the baseline for further exploration of combining the advantages of event cameras and conventional cameras for multi-animal tracking.