Multi-task Video Enhancement for Dental Interventions
This addresses visual comfort issues for dentists during procedures, though it is domain-specific and incremental in method.
The paper tackles video enhancement for dental interventions by introducing a novel deep network that jointly performs video restoration and temporal alignment, achieving state-of-the-art results with near real-time processing on a new dataset of dental videos.
A microcamera firmly attached to a dental handpiece allows dentists to continuously monitor the progress of conservative dental procedures. Video enhancement in video-assisted dental interventions alleviates low-light, noise, blur, and camera handshakes that collectively degrade visual comfort. To this end, we introduce a novel deep network for multi-task video enhancement that enables macro-visualization of dental scenes. In particular, the proposed network jointly leverages video restoration and temporal alignment in a multi-scale manner for effective video enhancement. Our experiments on videos of natural teeth in phantom scenes demonstrate that the proposed network achieves state-of-the-art results in multiple tasks with near real-time processing. We release Vident-lab at https://doi.org/10.34808/1jby-ay90, the first dataset of dental videos with multi-task labels to facilitate further research in relevant video processing applications.