Unsupervised Welding Defect Detection Using Audio And Video
This addresses the lack of real-time defect detection in robotic welding for industries, though it is incremental as it adapts existing deep learning methods to a new application.
The paper tackles the problem of detecting welding defects in robotic welding by applying unsupervised deep learning to audio and video recordings, achieving an average AUC of 0.92 across eleven defect types with a multi-modal approach.
In this work we explore the application of AI to robotic welding. Robotic welding is a widely used technology in many industries, but robots currently do not have the capability to detect welding defects which get introduced due to various reasons in the welding process. We describe how deep-learning methods can be applied to detect weld defects in real-time by recording the welding process with microphones and a camera. Our findings are based on a large database with more than 4000 welding samples we collected which covers different weld types, materials and various defect categories. All deep learning models are trained in an unsupervised fashion because the space of possible defects is large and the defects in our data may contain biases. We demonstrate that a reliable real-time detection of most categories of weld defects is feasible both from audio and video, with improvements achieved by combining both modalities. Specifically, the multi-modal approach achieves an average Area-under-ROC-Curve (AUC) of 0.92 over all eleven defect types in our data. We conclude the paper with an analysis of the results by defect type and a discussion of future work.