Making the Flow Glow -- Robot Perception under Severe Lighting Conditions using Normalizing Flow Gradients
This work addresses reliability issues in robotic perception for real-world deployment, but it is incremental as it builds on existing normalizing flow methods for out-of-distribution detection.
The paper tackled the problem of unreliable neural network-based robot perception under severe lighting conditions by using absolute gradient values from a normalizing flow to optimize local image regions, achieving a 60% higher success rate in object detection compared to previous methods.
Modern robotic perception is highly dependent on neural networks. It is well known that neural network-based perception can be unreliable in real-world deployment, especially in difficult imaging conditions. Out-of-distribution detection is commonly proposed as a solution for ensuring reliability in real-world deployment. Previous work has shown that normalizing flow models can be used for out-of-distribution detection to improve reliability of robotic perception tasks. Specifically, camera parameters can be optimized with respect to the likelihood output from a normalizing flow, which allows a perception system to adapt to difficult vision scenarios. With this work we propose to use the absolute gradient values from a normalizing flow, which allows the perception system to optimize local regions rather than the whole image. By setting up a table top picking experiment with exceptionally difficult lighting conditions, we show that our method achieves a 60% higher success rate for an object detection task compared to previous methods.