ReFlow6D: Refraction-Guided Transparent Object 6D Pose Estimation via Intermediate Representation LearningHrishikesh Gupta, Stefan Thalhammer, Jean-Baptiste Weibel et al.
Transparent objects are ubiquitous in daily life, making their perception and robotics manipulation important. However, they present a major challenge due to their distinct refractive and reflective properties when it comes to accurately estimating the 6D pose. To solve this, we present ReFlow6D, a novel method for transparent object 6D pose estimation that harnesses the refractive-intermediate representation. Unlike conventional approaches, our method leverages a feature space impervious to changes in RGB image space and independent of depth information. Drawing inspiration from image matting, we model the deformation of the light path through transparent objects, yielding a unique object-specific intermediate representation guided by light refraction that is independent of the environment in which objects are observed. By integrating these intermediate features into the pose estimation network, we show that ReFlow6D achieves precise 6D pose estimation of transparent objects, using only RGB images as input. Our method further introduces a novel transparent object compositing loss, fostering the generation of superior refractive-intermediate features. Empirical evaluations show that our approach significantly outperforms state-of-the-art methods on TOD and Trans32K-6D datasets. Robot grasping experiments further demonstrate that ReFlow6D's pose estimation accuracy effectively translates to real-world robotics task. The source code is available at: https://github.com/StoicGilgamesh/ReFlow6D and https://github.com/StoicGilgamesh/matting_rendering.
7.9LGJul 12, 2024
Robustness of Explainable Artificial Intelligence in Industrial Process ModellingBenedikt Kantz, Clemens Staudinger, Christoph Feilmayr et al.
eXplainable Artificial Intelligence (XAI) aims at providing understandable explanations of black box models. In this paper, we evaluate current XAI methods by scoring them based on ground truth simulations and sensitivity analysis. To this end, we used an Electric Arc Furnace (EAF) model to better understand the limits and robustness characteristics of XAI methods such as SHapley Additive exPlanations (SHAP), Local Interpretable Model-agnostic Explanations (LIME), as well as Averaged Local Effects (ALE) or Smooth Gradients (SG) in a highly topical setting. These XAI methods were applied to various types of black-box models and then scored based on their correctness compared to the ground-truth sensitivity of the data-generating processes using a novel scoring evaluation methodology over a range of simulated additive noise. The resulting evaluation shows that the capability of the Machine Learning (ML) models to capture the process accurately is, indeed, coupled with the correctness of the explainability of the underlying data-generating process. We furthermore show the differences between XAI methods in their ability to correctly predict the true sensitivity of the modeled industrial process.
1.2NAApr 16, 2019
Trace operators of the bi-Laplacian and applicationsThomas Führer, Alexander Haberl, Norbert Heuer
We study several trace operators and spaces that are related to the bi-Laplacian. They are motivated by the development of ultraweak formulations for the bi-Laplace equation with homogeneous Dirichlet condition, but are also relevant to describe conformity of mixed approximations. Our aim is to have well-posed (ultraweak) formulations that assume low regularity, under the condition of an $L_2$ right-hand side function. We pursue two ways of defining traces and corresponding integration-by-parts formulas. In one case one obtains a non-closed space. This can be fixed by switching to the Kirchhoff-Love traces from [Führer, Heuer, Niemi, An ultraweak formulation of the Kirchhoff-Love plate bending model and DPG approximation, Math. Comp., 88 (2019)]. Using different combinations of trace operators we obtain two well-posed formulations. For both of them we report on numerical experiments with the DPG method and optimal test functions. In this paper we consider two and three space dimensions. However, with the exception of a given counterexample in an appendix (related to the non-closedness of a trace space), our analysis applies to any space dimension larger than or equal to two.